Class cascading.JoinFieldedPipesPlatformTest

31

tests

0

failures

18m17.71s

duration

100%

successful

Tests

Test Duration Result
testCross 21.120s passed
testJoin 30.010s passed
testJoinAfterEvery 1m0.74s passed
testJoinAroundJoinLeftMost 51.363s passed
testJoinAroundJoinRightMost 24.722s passed
testJoinAroundJoinRightMostSwapped 47.886s passed
testJoinDiffFields 24.120s passed
testJoinFilteredBranch 57.262s passed
testJoinGroupBy 34.512s passed
testJoinGroupByJoin 51.121s passed
testJoinInner 30.177s passed
testJoinInnerOuter 27.037s passed
testJoinInnerSingleField 58.458s passed
testJoinMixed 0s passed
testJoinNone 27.125s passed
testJoinOuter 0s passed
testJoinOuterInner 0s passed
testJoinSamePipe 24.211s passed
testJoinSamePipe2 24.579s passed
testJoinSamePipe3 24.744s passed
testJoinSamePipeAroundGroupBy 1m3.19s passed
testJoinSamePipeName 26.812s passed
testJoinSameSourceIntoJoin 1m21.21s passed
testJoinSelf 45.213s passed
testJoinWithHasher 25.102s passed
testJoinWithUnknowns 24.185s passed
testJoinsIntoCoGroup 33.006s passed
testJoinsIntoCoGroupLhs 55.157s passed
testJoinsIntoCoGroupLhsSwappedJoin 33.369s passed
testJoinsIntoCoGroupRhs 59.093s passed
testJoinsIntoGroupBy 32.194s passed

Standard output

2013-10-31 16:04:37,714 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2013-10-31 16:04:37,733 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2013-10-31 16:04:37,734 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.JoinFieldedPipesPlatformTest
2013-10-31 16:04:37,760 INFO  hadoop.HadoopPlatform (HadoopPlatform.java:setUp(118)) - using cluster
2013-10-31 16:04:38,003 INFO  util.GSet (BlocksMap.java:computeCapacity(338)) - VM type       = 64-bit
2013-10-31 16:04:38,003 INFO  util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 16:04:38,003 INFO  util.GSet (BlocksMap.java:computeCapacity(340)) - capacity      = 2^21 = 2097152 entries
2013-10-31 16:04:38,004 INFO  util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 16:04:38,178 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 16:04:38,178 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 16:04:38,178 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 16:04:38,181 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 16:04:38,181 WARN  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 16:04:38,181 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 16:04:38,187 INFO  namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times 
2013-10-31 16:04:38,322 INFO  common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 16:04:38,664 INFO  common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name1 has been successfully formatted.
2013-10-31 16:04:38,666 INFO  common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 16:04:38,767 INFO  common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name2 has been successfully formatted.
2013-10-31 16:04:38,812 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-namenode.properties, hadoop-metrics2.properties
2013-10-31 16:04:38,883 INFO  util.GSet (BlocksMap.java:computeCapacity(338)) - VM type       = 64-bit
2013-10-31 16:04:38,883 INFO  util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 16:04:38,883 INFO  util.GSet (BlocksMap.java:computeCapacity(340)) - capacity      = 2^21 = 2097152 entries
2013-10-31 16:04:38,883 INFO  util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 16:04:38,887 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 16:04:38,888 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 16:04:38,888 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 16:04:38,888 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 16:04:38,888 WARN  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 16:04:38,889 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 16:04:38,891 INFO  namenode.FSNamesystem (FSNamesystem.java:registerMBean(5306)) - Registered FSNamesystemStateMBean and NameNodeMXBean
2013-10-31 16:04:38,892 INFO  namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times 
2013-10-31 16:04:38,896 INFO  common.Storage (FSImage.java:loadFSImage(899)) - Number of files = 1
2013-10-31 16:04:38,896 INFO  common.Storage (FSImage.java:loadFilesUnderConstruction(1435)) - Number of files under construction = 0
2013-10-31 16:04:38,896 INFO  common.Storage (FSImage.java:loadFSImage(832)) - Image file of size 112 loaded in 0 seconds.
2013-10-31 16:04:38,897 INFO  common.Storage (FSEditLog.java:loadFSEdits(901)) - Edits file build/test/data/dfs/name1/current/edits of size 4 edits # 0 loaded in 0 seconds.
2013-10-31 16:04:38,898 INFO  common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 16:04:38,943 INFO  common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 16:04:39,106 INFO  namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2013-10-31 16:04:39,107 INFO  namenode.FSNamesystem (FSNamesystem.java:initialize(397)) - Finished loading FSImage in 220 msecs
2013-10-31 16:04:39,127 INFO  namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3816)) - Total number of blocks = 0
2013-10-31 16:04:39,127 INFO  namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3817)) - Number of invalid blocks = 0
2013-10-31 16:04:39,127 INFO  namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3818)) - Number of under-replicated blocks = 0
2013-10-31 16:04:39,128 INFO  namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3819)) - Number of  over-replicated blocks = 0
2013-10-31 16:04:39,128 INFO  hdfs.StateChange (FSNamesystem.java:leave(4783)) - STATE* Safe mode termination scan for invalid, over- and under-replicated blocks completed in 18 msec
2013-10-31 16:04:39,128 INFO  hdfs.StateChange (FSNamesystem.java:leave(4789)) - STATE* Leaving safe mode after 0 secs.
2013-10-31 16:04:39,128 INFO  hdfs.StateChange (FSNamesystem.java:leave(4798)) - STATE* Network topology has 0 racks and 0 datanodes
2013-10-31 16:04:39,129 INFO  hdfs.StateChange (FSNamesystem.java:leave(4801)) - STATE* UnderReplicatedBlocks has 0 blocks
2013-10-31 16:04:39,136 INFO  util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 16:04:39,137 INFO  namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - ReplicateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 1 msec
2013-10-31 16:04:39,137 INFO  namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - ReplicateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 1 msec processing time, 1 msec clock time, 1 cycles
2013-10-31 16:04:39,138 INFO  namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - InvalidateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2013-10-31 16:04:39,138 INFO  namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - InvalidateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
2013-10-31 16:04:39,148 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:39,151 INFO  namenode.NameNode (NameNode.java:initialize(301)) - Namenode up at: /127.0.0.1:43856
2013-10-31 16:04:39,191 INFO  mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2013-10-31 16:04:39,241 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:39,250 INFO  http.HttpServer (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:39,256 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:39,257 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 37042 webServer.getConnectors()[0].getLocalPort() returned 37042
2013-10-31 16:04:39,257 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 37042
2013-10-31 16:04:39,257 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:39,293 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/hdfs to /tmp/Jetty_localhost_37042_hdfs____.8flzm4/webapp
2013-10-31 16:04:39,636 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:37042
2013-10-31 16:04:39,637 INFO  namenode.NameNode (NameNode.java:run(451)) - Web-server up at: localhost:37042
2013-10-31 16:04:39,637 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:39,637 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 43856: starting
2013-10-31 16:04:39,671 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 43856: starting
2013-10-31 16:04:39,672 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 43856: starting
2013-10-31 16:04:39,672 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 43856: starting
2013-10-31 16:04:39,673 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 43856: starting
2013-10-31 16:04:39,672 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 43856: starting
2013-10-31 16:04:39,671 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 43856: starting
2013-10-31 16:04:39,673 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 43856: starting
2013-10-31 16:04:39,673 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 43856: starting
2013-10-31 16:04:39,673 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 43856: starting
2013-10-31 16:04:39,672 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 43856: starting
2013-10-31 16:04:39,834 INFO  metrics.MetricsSaver (?:<init>(?)) - MetricsSaver GradleWorkerMain root:hdfs:///mnt/var/lib/hadoop/metrics/ period:60 instanceId:i-3e21d259 jobflow:j-3AAKWCJW7N40B
Starting DataNode 0 with dfs.data.dir: build/test/data/dfs/data/data1,build/test/data/dfs/data/data2
2013-10-31 16:04:39,873 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 16:04:39,874 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:39,913 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data1 is not formatted.
2013-10-31 16:04:39,914 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:41,209 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data2 is not formatted.
2013-10-31 16:04:41,210 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:41,319 INFO  datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 16:04:41,333 INFO  datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 38271
2013-10-31 16:04:41,337 INFO  datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 16:04:41,344 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:41,348 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:41,348 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:41,348 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 57719 webServer.getConnectors()[0].getLocalPort() returned 57719
2013-10-31 16:04:41,348 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 57719
2013-10-31 16:04:41,349 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:41,355 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_57719_datanode____rvo6jo/webapp
2013-10-31 16:04:41,535 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:57719
2013-10-31 16:04:41,539 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:41,539 INFO  datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:38271, storageID=, infoPort=57719, ipcPort=56394)
2013-10-31 16:04:41,551 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:38271 storage DS-799621837-10.5.128.102-38271-1383235481550
2013-10-31 16:04:41,554 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:38271
2013-10-31 16:04:41,607 INFO  datanode.DataNode (DataNode.java:register(733)) - New storage id DS-799621837-10.5.128.102-38271-1383235481550 is assigned to data-node 127.0.0.1:38271
2013-10-31 16:04:41,607 INFO  datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 16:04:41,610 INFO  hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:38271 0 blocks
2013-10-31 16:04:41,612 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 16:04:41,613 INFO  datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data1/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data2/current'}
2013-10-31 16:04:41,613 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
Starting DataNode 1 with dfs.data.dir: build/test/data/dfs/data/data3,build/test/data/dfs/data/data4
2013-10-31 16:04:41,616 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:41,616 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 56394: starting
2013-10-31 16:04:41,617 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 56394: starting
2013-10-31 16:04:41,619 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 56394: starting
2013-10-31 16:04:41,621 INFO  datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 16:04:41,621 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 56394: starting
2013-10-31 16:04:41,622 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 16:04:41,623 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:41,624 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:41,631 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:38271, blocks: 0, processing time: 1 msecs
2013-10-31 16:04:41,632 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 6 msec to generate and 3 msecs for RPC and NN processing
2013-10-31 16:04:41,632 INFO  datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 16:04:41,637 INFO  datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 1 ms
2013-10-31 16:04:41,637 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:41,658 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data3 is not formatted.
2013-10-31 16:04:41,658 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:41,824 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data4 is not formatted.
2013-10-31 16:04:41,825 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:41,933 INFO  datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 16:04:41,934 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:41,939 INFO  datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 47311
2013-10-31 16:04:41,939 INFO  datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 16:04:41,942 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:41,944 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:41,945 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:41,945 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 48798 webServer.getConnectors()[0].getLocalPort() returned 48798
2013-10-31 16:04:41,946 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 48798
2013-10-31 16:04:41,946 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:41,959 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_48798_datanode____61t8c9/webapp
2013-10-31 16:04:42,150 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:48798
2013-10-31 16:04:42,153 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:42,153 INFO  datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:47311, storageID=, infoPort=48798, ipcPort=34837)
2013-10-31 16:04:42,154 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:47311 storage DS-1772526979-10.5.128.102-47311-1383235482154
2013-10-31 16:04:42,155 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:47311
2013-10-31 16:04:42,196 INFO  datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1772526979-10.5.128.102-47311-1383235482154 is assigned to data-node 127.0.0.1:47311
2013-10-31 16:04:42,196 INFO  datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 16:04:42,197 INFO  hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:47311 0 blocks
2013-10-31 16:04:42,199 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
Starting DataNode 2 with dfs.data.dir: build/test/data/dfs/data/data5,build/test/data/dfs/data/data6
2013-10-31 16:04:42,200 INFO  datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data3/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data4/current'}
2013-10-31 16:04:42,200 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 16:04:42,203 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:42,203 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 34837: starting
2013-10-31 16:04:42,204 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 34837: starting
2013-10-31 16:04:42,205 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 34837: starting
2013-10-31 16:04:42,206 INFO  datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 16:04:42,208 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 34837: starting
2013-10-31 16:04:42,208 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 16:04:42,210 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:42,211 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:42,216 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:47311, blocks: 0, processing time: 0 msecs
2013-10-31 16:04:42,217 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 4 msec to generate and 2 msecs for RPC and NN processing
2013-10-31 16:04:42,218 INFO  datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 16:04:42,219 INFO  datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 1 ms
2013-10-31 16:04:42,221 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:42,247 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data5 is not formatted.
2013-10-31 16:04:42,247 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:42,458 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data6 is not formatted.
2013-10-31 16:04:42,459 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:42,566 INFO  datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 16:04:42,567 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:42,572 INFO  datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 41648
2013-10-31 16:04:42,572 INFO  datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 16:04:42,575 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:42,577 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:42,578 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:42,578 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 45464 webServer.getConnectors()[0].getLocalPort() returned 45464
2013-10-31 16:04:42,579 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 45464
2013-10-31 16:04:42,579 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:42,590 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_45464_datanode____12qsl4/webapp
2013-10-31 16:04:42,782 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:45464
2013-10-31 16:04:42,784 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:42,784 INFO  datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:41648, storageID=, infoPort=45464, ipcPort=44454)
2013-10-31 16:04:42,786 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:41648 storage DS-1634612289-10.5.128.102-41648-1383235482785
2013-10-31 16:04:42,786 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:41648
2013-10-31 16:04:42,821 INFO  datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1634612289-10.5.128.102-41648-1383235482785 is assigned to data-node 127.0.0.1:41648
2013-10-31 16:04:42,822 INFO  datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 16:04:42,823 INFO  hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:41648 0 blocks
2013-10-31 16:04:42,824 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
Starting DataNode 3 with dfs.data.dir: build/test/data/dfs/data/data7,build/test/data/dfs/data/data8
2013-10-31 16:04:42,825 INFO  datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data5/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data6/current'}
2013-10-31 16:04:42,825 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 16:04:42,828 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:42,829 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 44454: starting
2013-10-31 16:04:42,830 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 44454: starting
2013-10-31 16:04:42,833 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 44454: starting
2013-10-31 16:04:42,832 INFO  datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 16:04:42,831 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 44454: starting
2013-10-31 16:04:42,834 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 16:04:42,835 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:42,836 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:42,841 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:41648, blocks: 0, processing time: 0 msecs
2013-10-31 16:04:42,842 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 6 msec to generate and 1 msecs for RPC and NN processing
2013-10-31 16:04:42,843 INFO  datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 16:04:42,844 INFO  datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 1 ms
2013-10-31 16:04:42,847 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:42,867 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data7 is not formatted.
2013-10-31 16:04:42,868 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:44,429 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data8 is not formatted.
2013-10-31 16:04:44,430 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:44,550 INFO  datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 16:04:44,551 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:44,556 INFO  datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 50942
2013-10-31 16:04:44,556 INFO  datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 16:04:44,560 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:44,562 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:44,563 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:44,563 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 32926 webServer.getConnectors()[0].getLocalPort() returned 32926
2013-10-31 16:04:44,563 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 32926
2013-10-31 16:04:44,564 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:44,572 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_32926_datanode____ad2o2t/webapp
2013-10-31 16:04:44,750 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:32926
2013-10-31 16:04:44,752 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:44,752 INFO  datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:50942, storageID=, infoPort=32926, ipcPort=49535)
2013-10-31 16:04:44,754 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:50942 storage DS-1876337673-10.5.128.102-50942-1383235484753
2013-10-31 16:04:44,755 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:50942
2013-10-31 16:04:44,812 INFO  datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1876337673-10.5.128.102-50942-1383235484753 is assigned to data-node 127.0.0.1:50942
2013-10-31 16:04:44,813 INFO  datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 16:04:44,814 INFO  hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:50942 0 blocks
2013-10-31 16:04:44,815 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 16:04:44,816 INFO  datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data7/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data8/current'}
2013-10-31 16:04:44,817 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 16:04:44,820 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 49535: starting
2013-10-31 16:04:44,821 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 49535: starting
2013-10-31 16:04:44,823 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 49535: starting
2013-10-31 16:04:44,822 INFO  datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 16:04:44,822 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 49535: starting
2013-10-31 16:04:44,820 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:44,828 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:44,837 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:04:44,844 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:50942, blocks: 0, processing time: 0 msecs
2013-10-31 16:04:44,845 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 1 msec to generate and 17 msecs for RPC and NN processing
2013-10-31 16:04:44,845 INFO  datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 16:04:44,847 INFO  datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 16:04:44,848 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
Generating rack names for tasktrackers
Generating host names for tasktrackers
2013-10-31 16:04:44,967 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-jobtracker.properties, hadoop-metrics2.properties
2013-10-31 16:04:44,967 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=JobTracker,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:285)
	at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:114)
	at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:112)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132)
	at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:112)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:44,997 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 16:04:44,997 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(377)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2013-10-31 16:04:44,998 INFO  mapred.JobTracker (JobTracker.java:initializeTaskMemoryRelatedConfig(5174)) - Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2013-10-31 16:04:44,998 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 16:04:44,998 INFO  util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 16:04:45,000 INFO  mapred.JobTracker (JobTracker.java:<init>(2279)) - Starting jobtracker with owner as hadoop
2013-10-31 16:04:45,003 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:45,004 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:45,014 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:45,014 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 59186 webServer.getConnectors()[0].getLocalPort() returned 59186
2013-10-31 16:04:45,014 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 59186
2013-10-31 16:04:45,014 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:45,019 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/job to /tmp/Jetty_localhost_59186_job____icd3s3/webapp
2013-10-31 16:04:45,180 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:59186
2013-10-31 16:04:45,183 INFO  mapred.JobTracker (JobTracker.java:<init>(2347)) - JobTracker up at: 56620
2013-10-31 16:04:45,183 INFO  mapred.JobTracker (JobTracker.java:<init>(2351)) - JobTracker webserver: 59186
2013-10-31 16:04:45,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system	dst=null	perm=null
2013-10-31 16:04:45,191 INFO  mapred.JobTracker (JobTracker.java:<init>(2405)) - Creating the system directory
2013-10-31 16:04:45,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:04:45,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:04:45,319 INFO  mapred.JobTracker (JobTracker.java:<init>(2469)) - History server being initialized in embedded mode
2013-10-31 16:04:45,323 INFO  mapred.JobHistoryServer (JobHistoryServer.java:start(196)) - Started job history server at: localhost:59186
2013-10-31 16:04:45,324 INFO  mapred.JobTracker (JobTracker.java:<init>(2472)) - Job History Server web address: localhost:59186
2013-10-31 16:04:45,326 INFO  mapred.CompletedJobStatusStore (CompletedJobStatusStore.java:<init>(111)) - Completed job store is inactive
2013-10-31 16:04:45,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:04:45,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info	dst=null	perm=hadoop:supergroup:rw-------
2013-10-31 16:04:45,374 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info. blk_-8580097153134000137_1001
2013-10-31 16:04:45,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8580097153134000137_1001 src: /127.0.0.1:33458 dest: /127.0.0.1:50942
2013-10-31 16:04:45,399 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8580097153134000137_1001 src: /127.0.0.1:33528 dest: /127.0.0.1:38271
2013-10-31 16:04:45,401 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8580097153134000137_1001 src: /127.0.0.1:53565 dest: /127.0.0.1:41648
2013-10-31 16:04:45,406 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53565, dest: /127.0.0.1:41648, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8580097153134000137_1001, duration: 1974544
2013-10-31 16:04:45,407 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8580097153134000137_1001 terminating
2013-10-31 16:04:45,407 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8580097153134000137_1001 size 4
2013-10-31 16:04:45,408 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33528, dest: /127.0.0.1:38271, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8580097153134000137_1001, duration: 3601721
2013-10-31 16:04:45,411 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8580097153134000137_1001 terminating
2013-10-31 16:04:45,415 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33458, dest: /127.0.0.1:50942, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8580097153134000137_1001, duration: 9503327
2013-10-31 16:04:45,416 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8580097153134000137_1001 size 4
2013-10-31 16:04:45,416 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8580097153134000137_1001 terminating
2013-10-31 16:04:45,421 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info from client DFSClient_1457307213
2013-10-31 16:04:45,421 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info is closed by DFSClient_1457307213
2013-10-31 16:04:45,422 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8580097153134000137_1001 size 4
2013-10-31 16:04:45,428 INFO  mapred.JobTracker (JobTracker.java:refreshHosts(4945)) - Refreshing hosts information
2013-10-31 16:04:45,455 INFO  util.HostsFileReader (HostsFileReader.java:setIncludesFile(100)) - Setting the includes file to 
2013-10-31 16:04:45,455 INFO  util.HostsFileReader (HostsFileReader.java:setExcludesFile(105)) - Setting the excludes file to 
2013-10-31 16:04:45,455 INFO  util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 16:04:45,455 INFO  mapred.JobTracker (JobTracker.java:decommissionNodes(4989)) - Decommissioning 0 nodes
2013-10-31 16:04:45,456 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 56620: starting
2013-10-31 16:04:45,456 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 56620: starting
2013-10-31 16:04:45,456 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:45,456 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 56620: starting
2013-10-31 16:04:45,458 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 56620: starting
2013-10-31 16:04:45,458 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 56620: starting
2013-10-31 16:04:45,460 INFO  mapred.JobTracker (JobTracker.java:offerService(2630)) - Starting RUNNING
2013-10-31 16:04:45,460 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 56620: starting
2013-10-31 16:04:45,457 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 56620: starting
2013-10-31 16:04:45,460 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 56620: starting
2013-10-31 16:04:45,459 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 56620: starting
2013-10-31 16:04:45,459 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 56620: starting
2013-10-31 16:04:45,459 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 56620: starting
2013-10-31 16:04:45,861 INFO  mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0
2013-10-31 16:04:50,889 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:50,906 INFO  mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 16:04:50,909 INFO  mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 16:04:50,909 INFO  mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0
2013-10-31 16:04:50,922 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2013-10-31 16:04:50,927 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:50,927 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:50,928 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 51957: starting
2013-10-31 16:04:50,927 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 51957: starting
2013-10-31 16:04:50,929 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 51957: starting
2013-10-31 16:04:50,929 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 51957: starting
2013-10-31 16:04:50,929 INFO  mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:51957
2013-10-31 16:04:50,930 INFO  mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:04:50,929 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 51957: starting
2013-10-31 16:04:50,941 INFO  mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:04:50,950 INFO  util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2013-10-31 16:04:50,957 INFO  mapred.TaskTracker (TaskTracker.java:initialize(860)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6d8e324f
2013-10-31 16:04:50,961 WARN  mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 16:04:51,000 INFO  mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 16:04:51,007 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:51,007 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 38122 webServer.getConnectors()[0].getLocalPort() returned 38122
2013-10-31 16:04:51,007 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 38122
2013-10-31 16:04:51,008 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:51,012 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_38122_task____ifv6iy/webapp
2013-10-31 16:04:51,167 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:38122
2013-10-31 16:04:51,167 INFO  mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 16:04:51,168 INFO  mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0
2013-10-31 16:04:51,169 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,169 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,169 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,237 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,237 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,237 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,237 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:54,199 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/10.5.128.102
2013-10-31 16:04:54,202 INFO  mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:51957 to host 10.5.128.102
2013-10-31 16:04:56,175 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:56,178 INFO  mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 16:04:56,179 INFO  mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 16:04:56,180 INFO  mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0
2013-10-31 16:04:56,233 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:56,234 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 55789: starting
2013-10-31 16:04:56,234 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 55789: starting
2013-10-31 16:04:56,236 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 55789: starting
2013-10-31 16:04:56,235 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 55789: starting
2013-10-31 16:04:56,234 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:56,237 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 55789: starting
2013-10-31 16:04:56,237 INFO  mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:55789
2013-10-31 16:04:56,239 INFO  mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:55789
2013-10-31 16:04:56,244 INFO  mapred.TaskTracker (TaskTracker.java:initialize(860)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@226bd
2013-10-31 16:04:56,244 INFO  mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:55789
2013-10-31 16:04:56,247 WARN  mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 16:04:56,277 INFO  mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 16:04:56,279 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:56,279 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 43403 webServer.getConnectors()[0].getLocalPort() returned 43403
2013-10-31 16:04:56,279 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 43403
2013-10-31 16:04:56,279 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:56,284 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_43403_task____wfge46/webapp
2013-10-31 16:04:56,435 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:43403
2013-10-31 16:04:56,435 INFO  mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 16:04:56,436 INFO  mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0
2013-10-31 16:04:56,437 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:59,460 INFO  mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:55789 to host 10.5.128.102
2013-10-31 16:05:01,440 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:05:01,443 INFO  mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 16:05:01,444 INFO  mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 16:05:01,445 INFO  mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0
2013-10-31 16:05:01,475 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:05:01,476 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:05:01,476 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 43831: starting
2013-10-31 16:05:01,478 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 43831: starting
2013-10-31 16:05:01,476 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 43831: starting
2013-10-31 16:05:01,479 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 43831: starting
2013-10-31 16:05:01,479 INFO  mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:43831
2013-10-31 16:05:01,478 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 43831: starting
2013-10-31 16:05:01,481 INFO  mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:43831
2013-10-31 16:05:01,485 INFO  mapred.TaskTracker (TaskTracker.java:initialize(860)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4863309a
2013-10-31 16:05:01,486 INFO  mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:43831
2013-10-31 16:05:01,487 WARN  mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 16:05:01,515 INFO  mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 16:05:01,516 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:05:01,516 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 49137 webServer.getConnectors()[0].getLocalPort() returned 49137
2013-10-31 16:05:01,517 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 49137
2013-10-31 16:05:01,517 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:05:01,521 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_49137_task____52p9e6/webapp
2013-10-31 16:05:01,671 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:49137
2013-10-31 16:05:01,672 INFO  mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 16:05:01,673 INFO  mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0
2013-10-31 16:05:01,674 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,675 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,675 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,675 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,676 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,676 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,676 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,677 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,677 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,677 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,677 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,678 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,678 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,678 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,678 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,679 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,679 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,679 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,679 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,680 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,680 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,680 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,680 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,681 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,681 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,681 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,681 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,682 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,682 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,682 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,683 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,683 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,683 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,684 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,684 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,684 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,685 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,685 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,685 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,685 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,686 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,686 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,686 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,687 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,687 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,687 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,688 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,688 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,688 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,688 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,689 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,689 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,689 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,690 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,690 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,690 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,691 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,691 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,691 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,692 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,692 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,692 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,692 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,693 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,693 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,693 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,694 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,694 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,694 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,695 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,695 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,695 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,696 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,696 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,696 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,697 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,697 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,697 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,697 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,698 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,698 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,698 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,699 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,699 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,699 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,699 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,700 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,700 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,700 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,701 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,701 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,701 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,701 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,702 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,702 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,702 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,703 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,703 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,703 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,703 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,704 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,704 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,704 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,705 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,705 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,705 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,705 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,706 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,706 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,706 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,707 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,707 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,707 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,707 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:04,690 INFO  mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:43831 to host 10.5.128.102
2013-10-31 16:05:06,682 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:05:06,684 INFO  mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 16:05:06,686 INFO  mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 16:05:06,686 INFO  mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0
2013-10-31 16:05:06,714 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:05:06,715 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:05:06,716 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 34092: starting
2013-10-31 16:05:06,716 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 34092: starting
2013-10-31 16:05:06,718 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 34092: starting
2013-10-31 16:05:06,719 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 34092: starting
2013-10-31 16:05:06,719 INFO  mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:34092
2013-10-31 16:05:06,720 INFO  mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:05:06,719 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 34092: starting
2013-10-31 16:05:06,723 INFO  mapred.TaskTracker (TaskTracker.java:initialize(860)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6d0f2ab8
2013-10-31 16:05:06,723 INFO  mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:05:06,724 WARN  mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 16:05:06,741 INFO  mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 16:05:06,742 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:05:06,742 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 42911 webServer.getConnectors()[0].getLocalPort() returned 42911
2013-10-31 16:05:06,742 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 42911
2013-10-31 16:05:06,742 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:05:06,747 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_42911_task____99nbax/webapp
2013-10-31 16:05:06,936 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:42911
2013-10-31 16:05:06,936 INFO  mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 16:05:06,937 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,947 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,947 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,947 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:09,952 INFO  mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:34092 to host 10.5.128.102
2013-10-31 16:05:10,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:10,011 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt. blk_3600945390313710710_1002
2013-10-31 16:05:10,013 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3600945390313710710_1002 src: /127.0.0.1:53661 dest: /127.0.0.1:41648
2013-10-31 16:05:10,014 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3600945390313710710_1002 src: /127.0.0.1:33626 dest: /127.0.0.1:38271
2013-10-31 16:05:10,015 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3600945390313710710_1002 src: /127.0.0.1:46660 dest: /127.0.0.1:47311
2013-10-31 16:05:10,021 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46660, dest: /127.0.0.1:47311, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3600945390313710710_1002, duration: 4474396
2013-10-31 16:05:10,022 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3600945390313710710_1002 terminating
2013-10-31 16:05:10,023 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33626, dest: /127.0.0.1:38271, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3600945390313710710_1002, duration: 4334986
2013-10-31 16:05:10,023 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3600945390313710710_1002 terminating
2013-10-31 16:05:10,026 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53661, dest: /127.0.0.1:41648, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 5652378
2013-10-31 16:05:10,029 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3600945390313710710_1002 terminating
2013-10-31 16:05:10,031 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3600945390313710710_1002 size 15
2013-10-31 16:05:10,037 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt from client DFSClient_1457307213
2013-10-31 16:05:10,038 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt is closed by DFSClient_1457307213
2013-10-31 16:05:10,038 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3600945390313710710_1002 size 15
2013-10-31 16:05:10,039 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3600945390313710710_1002 size 15
2013-10-31 16:05:10,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:10,075 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt. blk_-5411765967275090315_1003
2013-10-31 16:05:10,078 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5411765967275090315_1003 src: /127.0.0.1:53664 dest: /127.0.0.1:41648
2013-10-31 16:05:10,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5411765967275090315_1003 src: /127.0.0.1:33560 dest: /127.0.0.1:50942
2013-10-31 16:05:10,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5411765967275090315_1003 src: /127.0.0.1:46663 dest: /127.0.0.1:47311
2013-10-31 16:05:10,089 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46663, dest: /127.0.0.1:47311, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 3229879
2013-10-31 16:05:10,090 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5411765967275090315_1003 terminating
2013-10-31 16:05:10,091 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5411765967275090315_1003 size 19
2013-10-31 16:05:10,093 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33560, dest: /127.0.0.1:50942, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 6443859
2013-10-31 16:05:10,093 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5411765967275090315_1003 terminating
2013-10-31 16:05:10,099 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53664, dest: /127.0.0.1:41648, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 9600271
2013-10-31 16:05:10,099 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5411765967275090315_1003 size 19
2013-10-31 16:05:10,099 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5411765967275090315_1003 terminating
2013-10-31 16:05:10,104 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5411765967275090315_1003 size 19
2013-10-31 16:05:10,105 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt from client DFSClient_1457307213
2013-10-31 16:05:10,105 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt is closed by DFSClient_1457307213
2013-10-31 16:05:10,156 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:05:10,157 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:05:10,166 INFO  property.AppProps (AppProps.java:getAppID(162)) - using app.id: ADA51C217F0D4666B25677A28777C299
2013-10-31 16:05:10,286 INFO  util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.2.0
2013-10-31 16:05:10,290 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:05:10,291 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:05:10,291 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt"]
2013-10-31 16:05:10,292 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle"]
2013-10-31 16:05:10,292 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:05:10,292 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:05:10,293 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:05:10,294 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...splatform/joininnersingle
2013-10-31 16:05:10,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:05:10,310 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:05:10,310 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:05:10,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:10,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:05:10,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:10,348 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar. blk_8168766256961359884_1004
2013-10-31 16:05:10,351 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8168766256961359884_1004 src: /127.0.0.1:53667 dest: /127.0.0.1:41648
2013-10-31 16:05:10,353 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8168766256961359884_1004 src: /127.0.0.1:33632 dest: /127.0.0.1:38271
2013-10-31 16:05:10,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8168766256961359884_1004 src: /127.0.0.1:46666 dest: /127.0.0.1:47311
2013-10-31 16:05:10,371 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46666, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8168766256961359884_1004, duration: 14241654
2013-10-31 16:05:10,372 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8168766256961359884_1004 terminating
2013-10-31 16:05:10,373 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8168766256961359884_1004 size 238055
2013-10-31 16:05:10,376 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33632, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8168766256961359884_1004, duration: 17358137
2013-10-31 16:05:10,376 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8168766256961359884_1004 terminating
2013-10-31 16:05:10,378 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53667, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8168766256961359884_1004, duration: 19646406
2013-10-31 16:05:10,379 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8168766256961359884_1004 size 238055
2013-10-31 16:05:10,379 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8168766256961359884_1004 terminating
2013-10-31 16:05:10,382 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8168766256961359884_1004 size 238055
2013-10-31 16:05:10,383 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar from client DFSClient_1457307213
2013-10-31 16:05:10,383 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar is closed by DFSClient_1457307213
2013-10-31 16:05:10,391 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar. New replication is 10
2013-10-31 16:05:10,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar	dst=null	perm=null
2013-10-31 16:05:10,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:10,403 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:05:10,426 WARN  snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2013-10-31 16:05:10,431 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:05:10,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 16:05:10,857 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-5411765967275090315_1003
2013-10-31 16:05:11,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,181 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split. New replication is 10
2013-10-31 16:05:11,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split	dst=null	perm=null
2013-10-31 16:05:11,195 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split. blk_6181555674910313919_1005
2013-10-31 16:05:11,198 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6181555674910313919_1005 src: /127.0.0.1:33634 dest: /127.0.0.1:38271
2013-10-31 16:05:11,200 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6181555674910313919_1005 src: /127.0.0.1:53671 dest: /127.0.0.1:41648
2013-10-31 16:05:11,202 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6181555674910313919_1005 src: /127.0.0.1:33567 dest: /127.0.0.1:50942
2013-10-31 16:05:11,204 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6181555674910313919_1005 src: /127.0.0.1:46670 dest: /127.0.0.1:47311
2013-10-31 16:05:11,211 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46670, dest: /127.0.0.1:47311, bytes: 1767, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6181555674910313919_1005, duration: 4266641
2013-10-31 16:05:11,211 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6181555674910313919_1005 terminating
2013-10-31 16:05:11,216 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33567, dest: /127.0.0.1:50942, bytes: 1767, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6181555674910313919_1005, duration: 8478316
2013-10-31 16:05:11,217 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6181555674910313919_1005 size 1767
2013-10-31 16:05:11,217 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6181555674910313919_1005 terminating
2013-10-31 16:05:11,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53671, dest: /127.0.0.1:41648, bytes: 1767, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6181555674910313919_1005, duration: 11957507
2013-10-31 16:05:11,222 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6181555674910313919_1005 size 1767
2013-10-31 16:05:11,222 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6181555674910313919_1005 terminating
2013-10-31 16:05:11,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33634, dest: /127.0.0.1:38271, bytes: 1767, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6181555674910313919_1005, duration: 15740488
2013-10-31 16:05:11,225 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6181555674910313919_1005 size 1767
2013-10-31 16:05:11,226 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6181555674910313919_1005 terminating
2013-10-31 16:05:11,229 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split from client DFSClient_1457307213
2013-10-31 16:05:11,230 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split is closed by DFSClient_1457307213
2013-10-31 16:05:11,230 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6181555674910313919_1005 size 1767
2013-10-31 16:05:11,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,257 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo. blk_-6344560666386114745_1006
2013-10-31 16:05:11,259 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6344560666386114745_1006 src: /127.0.0.1:53674 dest: /127.0.0.1:41648
2013-10-31 16:05:11,261 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6344560666386114745_1006 src: /127.0.0.1:46672 dest: /127.0.0.1:47311
2013-10-31 16:05:11,263 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6344560666386114745_1006 src: /127.0.0.1:33571 dest: /127.0.0.1:50942
2013-10-31 16:05:11,268 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33571, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6344560666386114745_1006, duration: 2671853
2013-10-31 16:05:11,268 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6344560666386114745_1006 terminating
2013-10-31 16:05:11,270 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46672, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6344560666386114745_1006, duration: 4918896
2013-10-31 16:05:11,271 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6344560666386114745_1006 terminating
2013-10-31 16:05:11,275 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6344560666386114745_1006 size 183
2013-10-31 16:05:11,275 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53674, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6344560666386114745_1006, duration: 7787124
2013-10-31 16:05:11,276 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6344560666386114745_1006 size 183
2013-10-31 16:05:11,276 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6344560666386114745_1006 terminating
2013-10-31 16:05:11,281 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6344560666386114745_1006 size 183
2013-10-31 16:05:11,281 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:05:11,282 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:05:11,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,433 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml. blk_-727194010295405234_1007
2013-10-31 16:05:11,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-727194010295405234_1007 src: /127.0.0.1:46674 dest: /127.0.0.1:47311
2013-10-31 16:05:11,436 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-727194010295405234_1007 src: /127.0.0.1:33642 dest: /127.0.0.1:38271
2013-10-31 16:05:11,436 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-727194010295405234_1007 src: /127.0.0.1:33574 dest: /127.0.0.1:50942
2013-10-31 16:05:11,442 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33574, dest: /127.0.0.1:50942, bytes: 28303, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-727194010295405234_1007, duration: 1349129
2013-10-31 16:05:11,442 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-727194010295405234_1007 terminating
2013-10-31 16:05:11,444 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33642, dest: /127.0.0.1:38271, bytes: 28303, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-727194010295405234_1007, duration: 2907237
2013-10-31 16:05:11,444 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-727194010295405234_1007 size 28303
2013-10-31 16:05:11,444 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-727194010295405234_1007 terminating
2013-10-31 16:05:11,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46674, dest: /127.0.0.1:47311, bytes: 28303, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-727194010295405234_1007, duration: 4931794
2013-10-31 16:05:11,447 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-727194010295405234_1007 terminating
2013-10-31 16:05:11,448 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-727194010295405234_1007 size 28303
2013-10-31 16:05:11,448 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml from client DFSClient_1457307213
2013-10-31 16:05:11,449 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml is closed by DFSClient_1457307213
2013-10-31 16:05:11,449 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-727194010295405234_1007 size 28303
2013-10-31 16:05:11,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml	dst=null	perm=null
2013-10-31 16:05:11,474 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33645, bytes: 28527, op: HDFS_READ, cliID: DFSClient_207335839, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-727194010295405234_1007, duration: 818994
2013-10-31 16:05:11,491 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0001: nMaps=5 nReduces=0 max=-1
2013-10-31 16:05:11,493 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0001 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:05:11,494 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0001	RESULT=SUCCESS
2013-10-31 16:05:11,494 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0001
2013-10-31 16:05:11,495 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0001
2013-10-31 16:05:11,497 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0001
2013-10-31 16:05:11,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,606 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_conf.xml. blk_3172384662314539439_1009
2013-10-31 16:05:11,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3172384662314539439_1009 src: /127.0.0.1:53682 dest: /127.0.0.1:41648
2013-10-31 16:05:11,608 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3172384662314539439_1009 src: /127.0.0.1:33578 dest: /127.0.0.1:50942
2013-10-31 16:05:11,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3172384662314539439_1009 src: /127.0.0.1:33648 dest: /127.0.0.1:38271
2013-10-31 16:05:11,612 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33648, dest: /127.0.0.1:38271, bytes: 28368, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3172384662314539439_1009, duration: 2363293
2013-10-31 16:05:11,612 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3172384662314539439_1009 terminating
2013-10-31 16:05:11,613 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33578, dest: /127.0.0.1:50942, bytes: 28368, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3172384662314539439_1009, duration: 2130565
2013-10-31 16:05:11,614 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3172384662314539439_1009 terminating
2013-10-31 16:05:11,615 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53682, dest: /127.0.0.1:41648, bytes: 28368, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3172384662314539439_1009, duration: 3416665
2013-10-31 16:05:11,615 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3172384662314539439_1009 terminating
2013-10-31 16:05:11,617 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3172384662314539439_1009 size 28368
2013-10-31 16:05:11,617 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_conf.xml from client DFSClient_207335839
2013-10-31 16:05:11,617 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_conf.xml is closed by DFSClient_207335839
2013-10-31 16:05:11,617 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3172384662314539439_1009 size 28368
2013-10-31 16:05:11,618 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3172384662314539439_1009 size 28368
2013-10-31 16:05:12,144 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_8168766256961359884_1004 to datanode(s) 127.0.0.1:50942
2013-10-31 16:05:12,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:12,317 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken. blk_-7983879404926687502_1010
2013-10-31 16:05:12,320 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7983879404926687502_1010 src: /127.0.0.1:33580 dest: /127.0.0.1:50942
2013-10-31 16:05:12,322 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7983879404926687502_1010 src: /127.0.0.1:46683 dest: /127.0.0.1:47311
2013-10-31 16:05:12,324 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7983879404926687502_1010 src: /127.0.0.1:33651 dest: /127.0.0.1:38271
2013-10-31 16:05:12,329 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33651, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7983879404926687502_1010, duration: 1520411
2013-10-31 16:05:12,329 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7983879404926687502_1010 terminating
2013-10-31 16:05:12,331 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46683, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7983879404926687502_1010, duration: 4120747
2013-10-31 16:05:12,332 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7983879404926687502_1010 size 116
2013-10-31 16:05:12,332 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7983879404926687502_1010 terminating
2013-10-31 16:05:12,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33580, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7983879404926687502_1010, duration: 7869725
2013-10-31 16:05:12,336 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7983879404926687502_1010 size 116
2013-10-31 16:05:12,338 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7983879404926687502_1010 terminating
2013-10-31 16:05:12,340 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7983879404926687502_1010 size 116
2013-10-31 16:05:12,341 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken from client DFSClient_1457307213
2013-10-31 16:05:12,341 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken is closed by DFSClient_1457307213
2013-10-31 16:05:12,347 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken
2013-10-31 16:05:12,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:05:12,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46685, bytes: 187, op: HDFS_READ, cliID: DFSClient_207335839, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6344560666386114745_1006, duration: 495355
2013-10-31 16:05:12,366 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0001 = 15. Number of splits = 5
2013-10-31 16:05:12,366 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1
2013-10-31 16:05:12,367 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,367 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,367 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,368 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,368 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,368 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,369 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,369 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,369 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,369 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,370 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,370 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,370 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,371 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,371 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,371 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0001 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:05:12,373 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0001 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:05:12,847 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_8168766256961359884_1004 to 127.0.0.1:50942 
2013-10-31 16:05:12,851 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8168766256961359884_1004 src: /127.0.0.1:33584 dest: /127.0.0.1:50942
2013-10-31 16:05:12,852 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_8168766256961359884_1004 to /127.0.0.1:50942
2013-10-31 16:05:12,856 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_8168766256961359884_1004 src: /127.0.0.1:33584 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:05:12,861 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8168766256961359884_1004 size 238055
2013-10-31 16:05:12,991 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0001_m_000006_0' to tip task_20131031160444934_0001_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:05:12,998 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:05:13,003 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000006_0 which needs 1 slots
2013-10-31 16:05:13,003 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000006_0 which needs 1 slots
2013-10-31 16:05:13,016 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 127 raw values into 2 aggregated values, total 2
2013-10-31 16:05:13,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken	dst=null	perm=null
2013-10-31 16:05:13,029 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46687, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7983879404926687502_1010, duration: 486421
2013-10-31 16:05:13,049 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml	dst=null	perm=null
2013-10-31 16:05:13,056 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46689, bytes: 28527, op: HDFS_READ, cliID: DFSClient_907600254, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-727194010295405234_1007, duration: 732530
2013-10-31 16:05:13,094 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:13,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar	dst=null	perm=null
2013-10-31 16:05:13,120 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53693, bytes: 239915, op: HDFS_READ, cliID: DFSClient_907600254, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8168766256961359884_1004, duration: 1857758
2013-10-31 16:05:13,259 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_1984937276
2013-10-31 16:05:13,260 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_1984937276 spawned.
2013-10-31 16:05:13,262 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000006_0/taskjvm.sh
2013-10-31 16:05:14,482 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_1984937276 given task: attempt_20131031160444934_0001_m_000006_0
2013-10-31 16:05:14,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:17,930 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000006_0 0.0% setup
2013-10-31 16:05:17,935 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000006_0 is done.
2013-10-31 16:05:17,936 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000006_0  was -1
2013-10-31 16:05:17,937 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:19,018 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000006_0' has completed task_20131031160444934_0001_m_000006 successfully.
2013-10-31 16:05:19,113 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000000_0' to tip task_20131031160444934_0001_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:05:19,116 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000000
2013-10-31 16:05:19,117 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000001_0' to tip task_20131031160444934_0001_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:05:19,117 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000001
2013-10-31 16:05:19,121 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:05:19,121 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:05:19,122 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000000_0 which needs 1 slots
2013-10-31 16:05:19,122 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000000_0 which needs 1 slots
2013-10-31 16:05:19,123 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000001_0 which needs 1 slots
2013-10-31 16:05:19,123 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0001_m_000001_0 which needs 1 slots
2013-10-31 16:05:19,163 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_-1113874899
2013-10-31 16:05:19,164 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_-1113874899 spawned.
2013-10-31 16:05:19,165 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0001/attempt_20131031160444934_0001_m_000000_0. Attempting to reuse: jvm_20131031160444934_0001_m_1984937276
2013-10-31 16:05:19,166 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000001_0/taskjvm.sh
2013-10-31 16:05:19,501 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_1984937276 given task: attempt_20131031160444934_0001_m_000000_0
2013-10-31 16:05:19,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split	dst=null	perm=null
2013-10-31 16:05:19,608 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33666, bytes: 1783, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6181555674910313919_1005, duration: 273764
2013-10-31 16:05:19,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 16:05:19,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:19,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:19,714 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000002_0' to tip task_20131031160444934_0001_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:19,715 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000002
2013-10-31 16:05:19,716 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000003_0' to tip task_20131031160444934_0001_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:19,716 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000003
2013-10-31 16:05:19,717 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:05:19,718 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:05:19,718 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000002_0 which needs 1 slots
2013-10-31 16:05:19,718 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000002_0 which needs 1 slots
2013-10-31 16:05:19,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000003_0 which needs 1 slots
2013-10-31 16:05:19,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0001_m_000003_0 which needs 1 slots
2013-10-31 16:05:19,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken	dst=null	perm=null
2013-10-31 16:05:19,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33598, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7983879404926687502_1010, duration: 207272
2013-10-31 16:05:19,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml	dst=null	perm=null
2013-10-31 16:05:19,737 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33600, bytes: 28527, op: HDFS_READ, cliID: DFSClient_-1256889339, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-727194010295405234_1007, duration: 279585
2013-10-31 16:05:19,760 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:19,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar	dst=null	perm=null
2013-10-31 16:05:19,783 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53706, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1256889339, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8168766256961359884_1004, duration: 1471615
2013-10-31 16:05:19,856 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_1565160902
2013-10-31 16:05:19,857 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_1565160902 spawned.
2013-10-31 16:05:19,858 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_206848199
2013-10-31 16:05:19,858 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_206848199 spawned.
2013-10-31 16:05:19,860 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000002_0/taskjvm.sh
2013-10-31 16:05:19,860 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000003_0/taskjvm.sh
2013-10-31 16:05:19,983 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_-1113874899 given task: attempt_20131031160444934_0001_m_000001_0
2013-10-31 16:05:20,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:20,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:20,080 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53708, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 193326
2013-10-31 16:05:20,083 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53709, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 164373
2013-10-31 16:05:20,090 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000. blk_-6758752448966261479_1011
2013-10-31 16:05:20,105 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758752448966261479_1011 src: /127.0.0.1:33605 dest: /127.0.0.1:50942
2013-10-31 16:05:20,106 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758752448966261479_1011 src: /127.0.0.1:33675 dest: /127.0.0.1:38271
2013-10-31 16:05:20,110 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758752448966261479_1011 src: /127.0.0.1:46709 dest: /127.0.0.1:47311
2013-10-31 16:05:20,113 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46709, dest: /127.0.0.1:47311, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6758752448966261479_1011, duration: 2268895
2013-10-31 16:05:20,114 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6758752448966261479_1011 terminating
2013-10-31 16:05:20,115 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33675, dest: /127.0.0.1:38271, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6758752448966261479_1011, duration: 3202209
2013-10-31 16:05:20,115 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6758752448966261479_1011 terminating
2013-10-31 16:05:20,116 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33605, dest: /127.0.0.1:50942, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6758752448966261479_1011, duration: 4472205
2013-10-31 16:05:20,116 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6758752448966261479_1011 terminating
2013-10-31 16:05:20,116 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6758752448966261479_1011 size 4
2013-10-31 16:05:20,117 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6758752448966261479_1011 size 4
2013-10-31 16:05:20,117 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6758752448966261479_1011 size 4
2013-10-31 16:05:20,118 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0001_m_000000_0
2013-10-31 16:05:20,119 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0001_m_000000_0
2013-10-31 16:05:20,288 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:20,289 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000000_0 0.0% 
2013-10-31 16:05:20,495 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000004_0' to tip task_20131031160444934_0001_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:05:20,495 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000004
2013-10-31 16:05:20,497 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:05:20,497 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000004_0 which needs 1 slots
2013-10-31 16:05:20,497 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000004_0 which needs 1 slots
2013-10-31 16:05:20,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken	dst=null	perm=null
2013-10-31 16:05:20,504 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46711, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7983879404926687502_1010, duration: 214302
2013-10-31 16:05:20,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml	dst=null	perm=null
2013-10-31 16:05:20,513 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33611, bytes: 28527, op: HDFS_READ, cliID: DFSClient_-1237662784, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-727194010295405234_1007, duration: 290353
2013-10-31 16:05:20,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split	dst=null	perm=null
2013-10-31 16:05:20,520 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33612, bytes: 1783, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6181555674910313919_1005, duration: 254770
2013-10-31 16:05:20,535 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:20,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar	dst=null	perm=null
2013-10-31 16:05:20,556 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33682, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1237662784, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8168766256961359884_1004, duration: 1431164
2013-10-31 16:05:20,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 16:05:20,560 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53719, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 172983
2013-10-31 16:05:20,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:20,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:20,627 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_331271179
2013-10-31 16:05:20,627 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_331271179 spawned.
2013-10-31 16:05:20,629 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000004_0/taskjvm.sh
2013-10-31 16:05:20,894 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_206848199 given task: attempt_20131031160444934_0001_m_000003_0
2013-10-31 16:05:21,089 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_1565160902 given task: attempt_20131031160444934_0001_m_000002_0
2013-10-31 16:05:21,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split	dst=null	perm=null
2013-10-31 16:05:21,412 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33618, bytes: 751, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6181555674910313919_1005, duration: 271729
2013-10-31 16:05:21,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 16:05:21,451 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53724, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 185046
2013-10-31 16:05:21,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split	dst=null	perm=null
2013-10-31 16:05:21,608 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53726, bytes: 1267, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6181555674910313919_1005, duration: 263717
2013-10-31 16:05:21,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 16:05:21,648 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53727, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 425403
2013-10-31 16:05:22,128 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000000_0
2013-10-31 16:05:22,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0	dst=null	perm=null
2013-10-31 16:05:22,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:22,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:22,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:22,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:22,910 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46725, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 190214
2013-10-31 16:05:22,919 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001. blk_7519423914612894981_1013
2013-10-31 16:05:22,941 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7519423914612894981_1013 src: /127.0.0.1:33624 dest: /127.0.0.1:50942
2013-10-31 16:05:22,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:22,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:22,962 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7519423914612894981_1013 src: /127.0.0.1:46727 dest: /127.0.0.1:47311
2013-10-31 16:05:22,963 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7519423914612894981_1013 src: /127.0.0.1:33695 dest: /127.0.0.1:38271
2013-10-31 16:05:22,967 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33695, dest: /127.0.0.1:38271, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7519423914612894981_1013, duration: 3023829
2013-10-31 16:05:22,968 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7519423914612894981_1013 terminating
2013-10-31 16:05:22,969 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46727, dest: /127.0.0.1:47311, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7519423914612894981_1013, duration: 4379037
2013-10-31 16:05:22,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:22,970 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7519423914612894981_1013 terminating
2013-10-31 16:05:22,973 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7519423914612894981_1013 size 4
2013-10-31 16:05:22,977 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33624, dest: /127.0.0.1:50942, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7519423914612894981_1013, duration: 11594221
2013-10-31 16:05:22,977 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7519423914612894981_1013 size 4
2013-10-31 16:05:22,978 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7519423914612894981_1013 terminating
2013-10-31 16:05:22,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0	dst=null	perm=null
2013-10-31 16:05:22,980 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7519423914612894981_1013 size 4
2013-10-31 16:05:22,980 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0001_m_000001_0
2013-10-31 16:05:22,981 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0001_m_000001_0
2013-10-31 16:05:22,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:23,055 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:23,055 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000001_0 0.0% 
2013-10-31 16:05:23,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:23,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:23,194 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33627, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 212792
2013-10-31 16:05:23,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:23,201 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0001_m_000003_0
2013-10-31 16:05:23,201 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0001_m_000003_0
2013-10-31 16:05:23,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:23,205 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33628, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 190975
2013-10-31 16:05:23,213 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0001_m_000002_0
2013-10-31 16:05:23,213 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0001_m_000002_0
2013-10-31 16:05:23,249 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:23,249 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000003_0 0.0% 
2013-10-31 16:05:23,495 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:23,495 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000002_0 0.0% 
2013-10-31 16:05:23,748 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_331271179 given task: attempt_20131031160444934_0001_m_000004_0
2013-10-31 16:05:24,122 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0001_m_000006_0
2013-10-31 16:05:24,123 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0001_m_000006_0
2013-10-31 16:05:24,123 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000006_0 not found in cache
2013-10-31 16:05:24,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split	dst=null	perm=null
2013-10-31 16:05:24,285 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53736, bytes: 751, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6181555674910313919_1005, duration: 263615
2013-10-31 16:05:24,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 16:05:24,326 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46734, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3600945390313710710_1002, duration: 447813
2013-10-31 16:05:24,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:24,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:24,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:24,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:24,576 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46735, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 360776
2013-10-31 16:05:24,593 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004. blk_765941219263834356_1015
2013-10-31 16:05:24,636 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_765941219263834356_1015 src: /127.0.0.1:53739 dest: /127.0.0.1:41648
2013-10-31 16:05:24,638 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_765941219263834356_1015 src: /127.0.0.1:33635 dest: /127.0.0.1:50942
2013-10-31 16:05:24,639 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_765941219263834356_1015 src: /127.0.0.1:33705 dest: /127.0.0.1:38271
2013-10-31 16:05:24,643 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33705, dest: /127.0.0.1:38271, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_765941219263834356_1015, duration: 2667483
2013-10-31 16:05:24,643 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_765941219263834356_1015 terminating
2013-10-31 16:05:24,644 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33635, dest: /127.0.0.1:50942, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_765941219263834356_1015, duration: 3403222
2013-10-31 16:05:24,645 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_765941219263834356_1015 size 4
2013-10-31 16:05:24,646 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53739, dest: /127.0.0.1:41648, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_765941219263834356_1015, duration: 4880546
2013-10-31 16:05:24,645 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_765941219263834356_1015 terminating
2013-10-31 16:05:24,646 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_765941219263834356_1015 terminating
2013-10-31 16:05:24,646 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_765941219263834356_1015 size 4
2013-10-31 16:05:24,647 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_765941219263834356_1015 size 4
2013-10-31 16:05:24,648 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0001_m_000004_0
2013-10-31 16:05:24,648 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0001_m_000004_0
2013-10-31 16:05:24,700 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:24,701 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000004_0 0.0% 
2013-10-31 16:05:25,133 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000001_0
2013-10-31 16:05:25,621 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:0+3
2013-10-31 16:05:25,630 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:0+3
2013-10-31 16:05:25,634 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000000_0 is done.
2013-10-31 16:05:25,635 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000000_0  was -1
2013-10-31 16:05:25,635 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:05:25,729 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000002_0
2013-10-31 16:05:25,729 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000003_0
2013-10-31 16:05:26,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0	dst=null	perm=null
2013-10-31 16:05:26,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:26,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:26,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0	dst=null	perm=null
2013-10-31 16:05:26,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0	dst=null	perm=null
2013-10-31 16:05:26,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:26,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:26,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0	dst=null	perm=null
2013-10-31 16:05:26,492 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:3+3
2013-10-31 16:05:26,497 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:3+3
2013-10-31 16:05:26,500 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000001_0 is done.
2013-10-31 16:05:26,500 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000001_0  was -1
2013-10-31 16:05:26,500 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:26,504 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000004_0
2013-10-31 16:05:26,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0	dst=null	perm=null
2013-10-31 16:05:26,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:26,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:26,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0	dst=null	perm=null
2013-10-31 16:05:26,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0	dst=null	perm=null
2013-10-31 16:05:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:26,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:26,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0	dst=null	perm=null
2013-10-31 16:05:27,192 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:12+3
2013-10-31 16:05:27,199 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000004_0 is done.
2013-10-31 16:05:27,199 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000004_0  was -1
2013-10-31 16:05:27,200 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:27,367 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000003_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:9+3
2013-10-31 16:05:27,372 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000003_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:9+3
2013-10-31 16:05:27,374 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000003_0 is done.
2013-10-31 16:05:27,374 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000003_0  was -1
2013-10-31 16:05:27,375 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:05:27,570 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:6+3
2013-10-31 16:05:27,574 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:6+3
2013-10-31 16:05:27,576 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000002_0 is done.
2013-10-31 16:05:27,576 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000002_0  was -1
2013-10-31 16:05:27,576 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:28,153 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000000_0' has completed task_20131031160444934_0001_m_000000 successfully.
2013-10-31 16:05:28,159 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000001_0' has completed task_20131031160444934_0001_m_000001 successfully.
2013-10-31 16:05:28,736 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000002_0' has completed task_20131031160444934_0001_m_000002 successfully.
2013-10-31 16:05:29,679 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000003_0' has completed task_20131031160444934_0001_m_000003 successfully.
2013-10-31 16:05:29,683 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000004_0' has completed task_20131031160444934_0001_m_000004 successfully.
2013-10-31 16:05:29,689 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0001_m_000005_0' to tip task_20131031160444934_0001_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:05:29,692 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:05:29,693 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000005_0 which needs 1 slots
2013-10-31 16:05:29,693 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000005_0 which needs 1 slots
2013-10-31 16:05:29,734 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_-710893147
2013-10-31 16:05:29,735 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_-710893147 spawned.
2013-10-31 16:05:29,736 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000005_0/taskjvm.sh
2013-10-31 16:05:30,550 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_-710893147 given task: attempt_20131031160444934_0001_m_000005_0
2013-10-31 16:05:31,076 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000005_0 0.0% 
2013-10-31 16:05:31,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary	dst=null	perm=null
2013-10-31 16:05:31,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:31,103 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_SUCCESS from client DFSClient_attempt_20131031160444934_0001_m_000005_0
2013-10-31 16:05:31,103 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0001_m_000005_0
2013-10-31 16:05:31,111 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8168766256961359884 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:31,111 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8168766256961359884 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:31,112 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8168766256961359884 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:31,112 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8168766256961359884 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:31,112 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6181555674910313919 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:31,112 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6181555674910313919 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:31,112 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6181555674910313919 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:31,113 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6181555674910313919 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:31,113 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6344560666386114745 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:31,113 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6344560666386114745 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:31,113 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6344560666386114745 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:31,113 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-727194010295405234 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:31,114 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-727194010295405234 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:31,114 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-727194010295405234 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:31,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001	dst=null	perm=null
2013-10-31 16:05:33,148 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_6181555674910313919_1005 blk_8168766256961359884_1004 blk_-727194010295405234_1007
2013-10-31 16:05:33,149 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_6181555674910313919_1005 blk_8168766256961359884_1004 blk_-727194010295405234_1007 blk_-6344560666386114745_1006
2013-10-31 16:05:33,227 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6344560666386114745_1006 file build/test/data/dfs/data/data3/current/blk_-6344560666386114745 for deletion
2013-10-31 16:05:33,228 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-727194010295405234_1007 file build/test/data/dfs/data/data4/current/blk_-727194010295405234 for deletion
2013-10-31 16:05:33,229 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6181555674910313919_1005 file build/test/data/dfs/data/data4/current/blk_6181555674910313919 for deletion
2013-10-31 16:05:33,229 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6344560666386114745_1006 at file build/test/data/dfs/data/data3/current/blk_-6344560666386114745
2013-10-31 16:05:33,229 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8168766256961359884_1004 file build/test/data/dfs/data/data3/current/blk_8168766256961359884 for deletion
2013-10-31 16:05:33,229 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-727194010295405234_1007 at file build/test/data/dfs/data/data4/current/blk_-727194010295405234
2013-10-31 16:05:33,230 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8168766256961359884_1004 at file build/test/data/dfs/data/data3/current/blk_8168766256961359884
2013-10-31 16:05:33,231 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6181555674910313919_1005 at file build/test/data/dfs/data/data4/current/blk_6181555674910313919
2013-10-31 16:05:33,988 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000005_0 0.0% cleanup
2013-10-31 16:05:33,991 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000005_0 is done.
2013-10-31 16:05:33,992 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000005_0  was -1
2013-10-31 16:05:33,992 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:35,640 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-727194010295405234_1007 file build/test/data/dfs/data/data1/current/blk_-727194010295405234 for deletion
2013-10-31 16:05:35,641 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6181555674910313919_1005 file build/test/data/dfs/data/data2/current/blk_6181555674910313919 for deletion
2013-10-31 16:05:35,642 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8168766256961359884_1004 file build/test/data/dfs/data/data1/current/blk_8168766256961359884 for deletion
2013-10-31 16:05:35,642 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6181555674910313919_1005 at file build/test/data/dfs/data/data2/current/blk_6181555674910313919
2013-10-31 16:05:35,642 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-727194010295405234_1007 at file build/test/data/dfs/data/data1/current/blk_-727194010295405234
2013-10-31 16:05:35,643 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8168766256961359884_1004 at file build/test/data/dfs/data/data1/current/blk_8168766256961359884
2013-10-31 16:05:35,704 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000005_0' has completed task_20131031160444934_0001_m_000005 successfully.
2013-10-31 16:05:35,708 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0001 has completed successfully.
2013-10-31 16:05:35,713 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0001,submitTime=1383235511463,launchTime=1383235512371,firstMapTaskLaunchTime=1383235519113,firstJobSetupTaskLaunchTime=1383235512958,firstJobCleanupTaskLaunchTime=1383235529689,finishTime=1383235535708,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=44,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[09F4FC493B6047ECA27EE8D8CB2299E6/6D365568CB3F48BA8CF7A01FD019301D] lower*upper/(1/1) ...splatform/joininnersingle
2013-10-31 16:05:35,720 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA. blk_5704600455657799651_1016
2013-10-31 16:05:35,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5704600455657799651_1016 src: /127.0.0.1:46746 dest: /127.0.0.1:47311
2013-10-31 16:05:35,725 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5704600455657799651_1016 src: /127.0.0.1:33645 dest: /127.0.0.1:50942
2013-10-31 16:05:35,727 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5704600455657799651_1016 src: /127.0.0.1:33715 dest: /127.0.0.1:38271
2013-10-31 16:05:35,737 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33715, dest: /127.0.0.1:38271, bytes: 25497, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5704600455657799651_1016, duration: 6157682
2013-10-31 16:05:35,738 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5704600455657799651_1016 terminating
2013-10-31 16:05:35,739 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33645, dest: /127.0.0.1:50942, bytes: 25497, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5704600455657799651_1016, duration: 7892709
2013-10-31 16:05:35,739 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5704600455657799651_1016 size 25497
2013-10-31 16:05:35,739 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5704600455657799651_1016 terminating
2013-10-31 16:05:35,740 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46746, dest: /127.0.0.1:47311, bytes: 25497, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5704600455657799651_1016, duration: 9281269
2013-10-31 16:05:35,740 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5704600455657799651_1016 terminating
2013-10-31 16:05:35,746 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5704600455657799651_1016 size 25497
2013-10-31 16:05:35,746 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA from client DFSClient_207335839
2013-10-31 16:05:35,747 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA is closed by DFSClient_207335839
2013-10-31 16:05:35,747 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5704600455657799651_1016 size 25497
2013-10-31 16:05:36,045 INFO  mapred.JobHistory (JobHistory.java:maybeMakeSubdirectory(403)) - Creating DONE subfolder at file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:05:36,050 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000004_0'
2013-10-31 16:05:36,051 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:05:36,051 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000005_0'
2013-10-31 16:05:36,054 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7983879404926687502 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:36,054 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7983879404926687502 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:36,055 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7983879404926687502 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:36,060 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0001_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:05:36,068 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary
2013-10-31 16:05:36,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001	dst=null	perm=null
2013-10-31 16:05:36,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2013-10-31 16:05:36,132 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:05:36,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2013-10-31 16:05:36,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2013-10-31 16:05:36,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2013-10-31 16:05:36,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2013-10-31 16:05:36,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2013-10-31 16:05:36,149 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-7983879404926687502_1010
2013-10-31 16:05:36,149 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_6181555674910313919_1005 blk_8168766256961359884_1004 blk_-7983879404926687502_1010 blk_-727194010295405234_1007 blk_-6344560666386114745_1006
2013-10-31 16:05:36,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2013-10-31 16:05:36,154 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46750, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6758752448966261479_1011, duration: 439598
2013-10-31 16:05:36,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2013-10-31 16:05:36,157 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33718, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7519423914612894981_1013, duration: 439852
2013-10-31 16:05:36,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2013-10-31 16:05:36,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2013-10-31 16:05:36,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2013-10-31 16:05:36,161 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33650, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_765941219263834356_1015, duration: 405293
2013-10-31 16:05:36,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2013-10-31 16:05:36,171 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:05:36,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2013-10-31 16:05:36,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2013-10-31 16:05:36,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2013-10-31 16:05:36,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2013-10-31 16:05:36,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2013-10-31 16:05:36,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2013-10-31 16:05:36,179 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33720, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6758752448966261479_1011, duration: 408617
2013-10-31 16:05:36,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2013-10-31 16:05:36,182 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33652, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7519423914612894981_1013, duration: 403801
2013-10-31 16:05:36,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2013-10-31 16:05:36,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2013-10-31 16:05:36,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2013-10-31 16:05:36,186 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33722, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_765941219263834356_1015, duration: 402940
2013-10-31 16:05:36,186 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joininnersingle
2013-10-31 16:05:36,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2013-10-31 16:05:36,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2013-10-31 16:05:36,196 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33723, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6758752448966261479_1011, duration: 396914
2013-10-31 16:05:36,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2013-10-31 16:05:36,202 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46757, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7519423914612894981_1013, duration: 384473
2013-10-31 16:05:36,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2013-10-31 16:05:36,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2013-10-31 16:05:36,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2013-10-31 16:05:36,214 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33656, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_765941219263834356_1015, duration: 411584
2013-10-31 16:05:36,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,229 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt. blk_8236244615419800290_1017
2013-10-31 16:05:36,231 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8236244615419800290_1017 src: /127.0.0.1:33726 dest: /127.0.0.1:38271
2013-10-31 16:05:36,233 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8236244615419800290_1017 src: /127.0.0.1:46760 dest: /127.0.0.1:47311
2013-10-31 16:05:36,235 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8236244615419800290_1017 src: /127.0.0.1:33659 dest: /127.0.0.1:50942
2013-10-31 16:05:36,239 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33659, dest: /127.0.0.1:50942, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 982323
2013-10-31 16:05:36,239 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8236244615419800290_1017 terminating
2013-10-31 16:05:36,242 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8236244615419800290_1017 size 19
2013-10-31 16:05:36,242 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46760, dest: /127.0.0.1:47311, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 4260728
2013-10-31 16:05:36,243 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8236244615419800290_1017 terminating
2013-10-31 16:05:36,243 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33726, dest: /127.0.0.1:38271, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 5495602
2013-10-31 16:05:36,244 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8236244615419800290_1017 terminating
2013-10-31 16:05:36,247 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8236244615419800290_1017 size 19
2013-10-31 16:05:36,247 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt from client DFSClient_1457307213
2013-10-31 16:05:36,248 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt is closed by DFSClient_1457307213
2013-10-31 16:05:36,248 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8236244615419800290_1017 size 19
2013-10-31 16:05:36,280 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:05:36,281 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:05:36,281 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0001
2013-10-31 16:05:36,282 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0001 being deleted.
2013-10-31 16:05:36,331 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] starting
2013-10-31 16:05:36,332 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:05:36,332 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:05:36,332 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:05:36,333 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost"]
2013-10-31 16:05:36,334 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower]  parallel execution is enabled: true
2013-10-31 16:05:36,334 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower]  starting jobs: 2
2013-10-31 16:05:36,334 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower]  allocating threads: 2
2013-10-31 16:05:36,335 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper1*upper2*lower] starting step: (2/2)
2013-10-31 16:05:36,340 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:05:36,340 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:05:36,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:36,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:05:36,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,361 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar. blk_-2674703006665761127_1018
2013-10-31 16:05:36,363 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2674703006665761127_1018 src: /127.0.0.1:33660 dest: /127.0.0.1:50942
2013-10-31 16:05:36,364 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2674703006665761127_1018 src: /127.0.0.1:46763 dest: /127.0.0.1:47311
2013-10-31 16:05:36,365 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2674703006665761127_1018 src: /127.0.0.1:53767 dest: /127.0.0.1:41648
2013-10-31 16:05:36,371 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53767, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2674703006665761127_1018, duration: 4610158
2013-10-31 16:05:36,371 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2674703006665761127_1018 terminating
2013-10-31 16:05:36,372 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46763, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2674703006665761127_1018, duration: 5030433
2013-10-31 16:05:36,372 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2674703006665761127_1018 terminating
2013-10-31 16:05:36,372 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33660, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2674703006665761127_1018, duration: 4993897
2013-10-31 16:05:36,372 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2674703006665761127_1018 size 238055
2013-10-31 16:05:36,372 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2674703006665761127_1018 terminating
2013-10-31 16:05:36,374 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2674703006665761127_1018 size 238055
2013-10-31 16:05:36,374 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar from client DFSClient_1457307213
2013-10-31 16:05:36,374 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar is closed by DFSClient_1457307213
2013-10-31 16:05:36,375 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2674703006665761127_1018 size 238055
2013-10-31 16:05:36,379 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar. New replication is 10
2013-10-31 16:05:36,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar	dst=null	perm=null
2013-10-31 16:05:36,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,387 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:05:36,395 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:05:36,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:36,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,412 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split. New replication is 10
2013-10-31 16:05:36,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split	dst=null	perm=null
2013-10-31 16:05:36,419 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split. blk_697700709896827018_1019
2013-10-31 16:05:36,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_697700709896827018_1019 src: /127.0.0.1:33663 dest: /127.0.0.1:50942
2013-10-31 16:05:36,421 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_697700709896827018_1019 src: /127.0.0.1:33733 dest: /127.0.0.1:38271
2013-10-31 16:05:36,423 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_697700709896827018_1019 src: /127.0.0.1:53770 dest: /127.0.0.1:41648
2013-10-31 16:05:36,423 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_697700709896827018_1019 src: /127.0.0.1:46768 dest: /127.0.0.1:47311
2013-10-31 16:05:36,427 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46768, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_697700709896827018_1019, duration: 1539980
2013-10-31 16:05:36,427 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_697700709896827018_1019 terminating
2013-10-31 16:05:36,427 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53770, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_697700709896827018_1019, duration: 1972195
2013-10-31 16:05:36,427 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_697700709896827018_1019 terminating
2013-10-31 16:05:36,427 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33733, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_697700709896827018_1019, duration: 2210902
2013-10-31 16:05:36,428 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_697700709896827018_1019 terminating
2013-10-31 16:05:36,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33663, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_697700709896827018_1019, duration: 2308724
2013-10-31 16:05:36,428 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_697700709896827018_1019 terminating
2013-10-31 16:05:36,430 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_697700709896827018_1019 size 1732
2013-10-31 16:05:36,431 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split from client DFSClient_1457307213
2013-10-31 16:05:36,431 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split is closed by DFSClient_1457307213
2013-10-31 16:05:36,431 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_697700709896827018_1019 size 1732
2013-10-31 16:05:36,432 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_697700709896827018_1019 size 1732
2013-10-31 16:05:36,432 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_697700709896827018_1019 size 1732
2013-10-31 16:05:36,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,451 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo. blk_-2325358903431004453_1020
2013-10-31 16:05:36,453 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2325358903431004453_1020 src: /127.0.0.1:53772 dest: /127.0.0.1:41648
2013-10-31 16:05:36,455 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2325358903431004453_1020 src: /127.0.0.1:33668 dest: /127.0.0.1:50942
2013-10-31 16:05:36,456 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2325358903431004453_1020 src: /127.0.0.1:46771 dest: /127.0.0.1:47311
2013-10-31 16:05:36,460 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46771, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2325358903431004453_1020, duration: 72445
2013-10-31 16:05:36,460 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2325358903431004453_1020 terminating
2013-10-31 16:05:36,461 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33668, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2325358903431004453_1020, duration: 1018329
2013-10-31 16:05:36,461 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2325358903431004453_1020 terminating
2013-10-31 16:05:36,462 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53772, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2325358903431004453_1020, duration: 1989052
2013-10-31 16:05:36,463 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2325358903431004453_1020 terminating
2013-10-31 16:05:36,463 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2325358903431004453_1020 size 183
2013-10-31 16:05:36,464 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2325358903431004453_1020 size 183
2013-10-31 16:05:36,465 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2325358903431004453_1020 size 183
2013-10-31 16:05:36,465 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:05:36,466 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:05:36,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,505 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml. blk_-2999485849396669780_1021
2013-10-31 16:05:36,507 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2999485849396669780_1021 src: /127.0.0.1:46772 dest: /127.0.0.1:47311
2013-10-31 16:05:36,509 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2999485849396669780_1021 src: /127.0.0.1:33671 dest: /127.0.0.1:50942
2013-10-31 16:05:36,511 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2999485849396669780_1021 src: /127.0.0.1:53777 dest: /127.0.0.1:41648
2013-10-31 16:05:36,514 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53777, dest: /127.0.0.1:41648, bytes: 27432, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2999485849396669780_1021, duration: 489878
2013-10-31 16:05:36,514 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2999485849396669780_1021 terminating
2013-10-31 16:05:36,515 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33671, dest: /127.0.0.1:50942, bytes: 27432, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2999485849396669780_1021, duration: 1391337
2013-10-31 16:05:36,515 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2999485849396669780_1021 terminating
2013-10-31 16:05:36,516 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46772, dest: /127.0.0.1:47311, bytes: 27432, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2999485849396669780_1021, duration: 2432977
2013-10-31 16:05:36,516 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2999485849396669780_1021 terminating
2013-10-31 16:05:36,520 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2999485849396669780_1021 size 27432
2013-10-31 16:05:36,521 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml from client DFSClient_1457307213
2013-10-31 16:05:36,521 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml is closed by DFSClient_1457307213
2013-10-31 16:05:36,522 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2999485849396669780_1021 size 27432
2013-10-31 16:05:36,522 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2999485849396669780_1021 size 27432
2013-10-31 16:05:36,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml	dst=null	perm=null
2013-10-31 16:05:36,545 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53779, bytes: 27648, op: HDFS_READ, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2999485849396669780_1021, duration: 609031
2013-10-31 16:05:36,568 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0002: nMaps=5 nReduces=0 max=-1
2013-10-31 16:05:36,569 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0002 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:05:36,569 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0002	RESULT=SUCCESS
2013-10-31 16:05:36,570 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0002
2013-10-31 16:05:36,570 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0002
2013-10-31 16:05:36,572 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper1*upper2*lower] submitted hadoop job: job_20131031160444934_0002
2013-10-31 16:05:37,174 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000000_0'
2013-10-31 16:05:37,175 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000001_0'
2013-10-31 16:05:37,175 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000006_0'
2013-10-31 16:05:37,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:37,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:37,239 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_conf.xml. blk_6715209515672176699_1023
2013-10-31 16:05:37,241 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6715209515672176699_1023 src: /127.0.0.1:33675 dest: /127.0.0.1:50942
2013-10-31 16:05:37,242 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6715209515672176699_1023 src: /127.0.0.1:33745 dest: /127.0.0.1:38271
2013-10-31 16:05:37,243 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6715209515672176699_1023 src: /127.0.0.1:53782 dest: /127.0.0.1:41648
2013-10-31 16:05:37,246 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53782, dest: /127.0.0.1:41648, bytes: 27497, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6715209515672176699_1023, duration: 2250236
2013-10-31 16:05:37,247 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6715209515672176699_1023 terminating
2013-10-31 16:05:37,247 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33745, dest: /127.0.0.1:38271, bytes: 27497, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6715209515672176699_1023, duration: 2324899
2013-10-31 16:05:37,247 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6715209515672176699_1023 terminating
2013-10-31 16:05:37,248 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33675, dest: /127.0.0.1:50942, bytes: 27497, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6715209515672176699_1023, duration: 1928796
2013-10-31 16:05:37,248 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6715209515672176699_1023 terminating
2013-10-31 16:05:37,250 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6715209515672176699_1023 size 27497
2013-10-31 16:05:37,250 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6715209515672176699_1023 size 27497
2013-10-31 16:05:37,251 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6715209515672176699_1023 size 27497
2013-10-31 16:05:37,650 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_conf.xml from client DFSClient_-1555598147
2013-10-31 16:05:37,651 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_conf.xml is closed by DFSClient_-1555598147
2013-10-31 16:05:37,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:37,666 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken. blk_-5382160867474461323_1024
2013-10-31 16:05:37,668 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5382160867474461323_1024 src: /127.0.0.1:33678 dest: /127.0.0.1:50942
2013-10-31 16:05:37,670 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5382160867474461323_1024 src: /127.0.0.1:53784 dest: /127.0.0.1:41648
2013-10-31 16:05:37,672 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5382160867474461323_1024 src: /127.0.0.1:33749 dest: /127.0.0.1:38271
2013-10-31 16:05:37,675 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33749, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5382160867474461323_1024, duration: 66734
2013-10-31 16:05:37,675 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5382160867474461323_1024 terminating
2013-10-31 16:05:37,676 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53784, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5382160867474461323_1024, duration: 1098407
2013-10-31 16:05:37,676 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5382160867474461323_1024 terminating
2013-10-31 16:05:37,677 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33678, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5382160867474461323_1024, duration: 2165330
2013-10-31 16:05:37,678 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5382160867474461323_1024 terminating
2013-10-31 16:05:37,678 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5382160867474461323_1024 size 116
2013-10-31 16:05:37,683 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken from client DFSClient_1457307213
2013-10-31 16:05:37,683 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken is closed by DFSClient_1457307213
2013-10-31 16:05:37,683 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5382160867474461323_1024 size 116
2013-10-31 16:05:37,684 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5382160867474461323_1024 size 116
2013-10-31 16:05:37,689 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken
2013-10-31 16:05:37,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:05:37,696 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33681, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2325358903431004453_1020, duration: 413332
2013-10-31 16:05:37,700 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0002 = 19. Number of splits = 5
2013-10-31 16:05:37,701 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,701 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,701 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,702 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,702 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,702 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,702 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,703 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,703 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,703 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,703 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,704 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,704 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,704 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,704 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,705 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0002 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:05:37,705 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0002 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:05:38,641 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7983879404926687502_1010 file build/test/data/dfs/data/data1/current/blk_-7983879404926687502 for deletion
2013-10-31 16:05:38,642 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7983879404926687502_1010 at file build/test/data/dfs/data/data1/current/blk_-7983879404926687502
2013-10-31 16:05:38,696 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0002_m_000006_0' to tip task_20131031160444934_0002_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:38,702 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000002_0'
2013-10-31 16:05:38,702 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000003_0'
2013-10-31 16:05:38,704 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:05:38,705 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000006_0 which needs 1 slots
2013-10-31 16:05:38,705 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000006_0 which needs 1 slots
2013-10-31 16:05:38,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken	dst=null	perm=null
2013-10-31 16:05:38,717 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33682, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5382160867474461323_1024, duration: 417982
2013-10-31 16:05:38,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml	dst=null	perm=null
2013-10-31 16:05:38,733 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33684, bytes: 27648, op: HDFS_READ, cliID: DFSClient_-453984156, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2999485849396669780_1021, duration: 590329
2013-10-31 16:05:38,768 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:38,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar	dst=null	perm=null
2013-10-31 16:05:38,802 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53790, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-453984156, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2674703006665761127_1018, duration: 1781215
2013-10-31 16:05:38,843 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7983879404926687502_1010 file build/test/data/dfs/data/data7/current/blk_-7983879404926687502 for deletion
2013-10-31 16:05:38,843 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6344560666386114745_1006 file build/test/data/dfs/data/data8/current/blk_-6344560666386114745 for deletion
2013-10-31 16:05:38,843 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-727194010295405234_1007 file build/test/data/dfs/data/data7/current/blk_-727194010295405234 for deletion
2013-10-31 16:05:38,843 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6181555674910313919_1005 file build/test/data/dfs/data/data7/current/blk_6181555674910313919 for deletion
2013-10-31 16:05:38,844 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8168766256961359884_1004 file build/test/data/dfs/data/data8/current/blk_8168766256961359884 for deletion
2013-10-31 16:05:38,844 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7983879404926687502_1010 at file build/test/data/dfs/data/data7/current/blk_-7983879404926687502
2013-10-31 16:05:38,844 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6344560666386114745_1006 at file build/test/data/dfs/data/data8/current/blk_-6344560666386114745
2013-10-31 16:05:38,844 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-727194010295405234_1007 at file build/test/data/dfs/data/data7/current/blk_-727194010295405234
2013-10-31 16:05:38,845 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8168766256961359884_1004 at file build/test/data/dfs/data/data8/current/blk_8168766256961359884
2013-10-31 16:05:38,845 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6181555674910313919_1005 at file build/test/data/dfs/data/data7/current/blk_6181555674910313919
2013-10-31 16:05:38,912 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0001_m_1565160902
2013-10-31 16:05:38,923 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10060 with signal TERM. Exit code 0
2013-10-31 16:05:38,924 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_1252934869
2013-10-31 16:05:38,925 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_1252934869 spawned.
2013-10-31 16:05:38,931 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000006_0/taskjvm.sh
2013-10-31 16:05:39,022 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:39,022 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:39,022 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:05:39,023 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_1565160902 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:39,150 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-2674703006665761127_1018 to datanode(s) 127.0.0.1:38271
2013-10-31 16:05:39,151 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_6181555674910313919_1005 blk_8168766256961359884_1004 blk_-6344560666386114745_1006
2013-10-31 16:05:39,151 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-7983879404926687502_1010
2013-10-31 16:05:39,228 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7983879404926687502_1010 file build/test/data/dfs/data/data3/current/blk_-7983879404926687502 for deletion
2013-10-31 16:05:39,229 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7983879404926687502_1010 at file build/test/data/dfs/data/data3/current/blk_-7983879404926687502
2013-10-31 16:05:39,838 INFO  metrics.MetricsUtil (?:emrClusterStarted(?)) - instance controller state completed
2013-10-31 16:05:39,854 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-2674703006665761127_1018 to 127.0.0.1:38271 
2013-10-31 16:05:39,855 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6344560666386114745_1006 file build/test/data/dfs/data/data6/current/blk_-6344560666386114745 for deletion
2013-10-31 16:05:39,856 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6181555674910313919_1005 file build/test/data/dfs/data/data5/current/blk_6181555674910313919 for deletion
2013-10-31 16:05:39,856 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2674703006665761127_1018 src: /127.0.0.1:33755 dest: /127.0.0.1:38271
2013-10-31 16:05:39,856 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-2674703006665761127_1018 to /127.0.0.1:38271
2013-10-31 16:05:39,856 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8168766256961359884_1004 file build/test/data/dfs/data/data6/current/blk_8168766256961359884 for deletion
2013-10-31 16:05:39,856 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:05:39,856 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6344560666386114745_1006 at file build/test/data/dfs/data/data6/current/blk_-6344560666386114745
2013-10-31 16:05:39,857 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6181555674910313919_1005 at file build/test/data/dfs/data/data5/current/blk_6181555674910313919
2013-10-31 16:05:39,857 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8168766256961359884_1004 at file build/test/data/dfs/data/data6/current/blk_8168766256961359884
2013-10-31 16:05:39,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2674703006665761127_1018 src: /127.0.0.1:33755 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:05:39,861 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2674703006665761127_1018 size 238055
2013-10-31 16:05:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,877 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,883 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,889 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,896 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,902 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,902 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 42 records
2013-10-31 16:05:40,450 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_1252934869 given task: attempt_20131031160444934_0002_m_000006_0
2013-10-31 16:05:40,976 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 137 Total time for transactions(ms): 7Number of transactions batched in Syncs: 9 Number of syncs: 85 SyncTimes(ms): 4245 455 
2013-10-31 16:05:40,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:41,053 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0001
2013-10-31 16:05:41,053 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000004_0 not found in cache
2013-10-31 16:05:41,054 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000005_0 not found in cache
2013-10-31 16:05:41,056 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0001 for user-log deletion with retainTimeStamp:1383321941056
2013-10-31 16:05:41,269 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_331271179 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:41,284 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10166 with signal TERM. Exit code 0
2013-10-31 16:05:41,469 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:41,470 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:41,470 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:05:41,470 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_331271179 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:42,069 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_-710893147 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:42,083 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10269 with signal TERM. Exit code 0
2013-10-31 16:05:42,176 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0001
2013-10-31 16:05:42,176 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000001_0 not found in cache
2013-10-31 16:05:42,176 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000000_0 not found in cache
2013-10-31 16:05:42,177 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0001 for user-log deletion with retainTimeStamp:1383321942177
2013-10-31 16:05:42,247 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:42,247 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:42,247 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:05:42,247 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_-710893147 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:42,691 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_1984937276 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:42,704 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9877 with signal TERM. Exit code 0
2013-10-31 16:05:42,872 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:42,872 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:42,872 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:05:42,872 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_1984937276 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:05:43,576 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_-1113874899 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:43,588 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9945 with signal TERM. Exit code 0
2013-10-31 16:05:43,705 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0001
2013-10-31 16:05:43,705 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000003_0 not found in cache
2013-10-31 16:05:43,706 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000002_0 not found in cache
2013-10-31 16:05:43,706 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0001 for user-log deletion with retainTimeStamp:1383321943706
2013-10-31 16:05:43,764 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:43,764 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:43,765 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:05:43,765 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_-1113874899 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:43,887 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000006_0 0.0% setup
2013-10-31 16:05:43,891 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000006_0 is done.
2013-10-31 16:05:43,891 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000006_0  was -1
2013-10-31 16:05:43,891 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:44,430 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_206848199 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:44,440 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10022 with signal TERM. Exit code 0
2013-10-31 16:05:44,646 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:44,646 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:44,646 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:05:44,646 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_206848199 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:44,660 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3600945390313710710_1002
2013-10-31 16:05:44,712 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000006_0' has completed task_20131031160444934_0002_m_000006 successfully.
2013-10-31 16:05:44,716 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000000_0' to tip task_20131031160444934_0002_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:44,717 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000000
2013-10-31 16:05:44,718 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000001_0' to tip task_20131031160444934_0002_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:44,719 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000001
2013-10-31 16:05:44,722 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:05:44,723 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:05:44,723 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000000_0 which needs 1 slots
2013-10-31 16:05:44,723 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000000_0 which needs 1 slots
2013-10-31 16:05:44,723 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000001_0 which needs 1 slots
2013-10-31 16:05:44,724 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0002_m_000001_0 which needs 1 slots
2013-10-31 16:05:44,758 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_481603449
2013-10-31 16:05:44,759 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_481603449 spawned.
2013-10-31 16:05:44,760 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0002/attempt_20131031160444934_0002_m_000000_0. Attempting to reuse: jvm_20131031160444934_0002_m_1252934869
2013-10-31 16:05:44,761 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000001_0/taskjvm.sh
2013-10-31 16:05:44,944 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_1252934869 given task: attempt_20131031160444934_0002_m_000000_0
2013-10-31 16:05:45,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split	dst=null	perm=null
2013-10-31 16:05:45,064 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53795, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_697700709896827018_1019, duration: 214952
2013-10-31 16:05:45,066 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000002_0' to tip task_20131031160444934_0002_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:05:45,066 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000002
2013-10-31 16:05:45,067 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000003_0' to tip task_20131031160444934_0002_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:05:45,067 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000003
2013-10-31 16:05:45,068 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:05:45,068 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:05:45,068 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000002_0 which needs 1 slots
2013-10-31 16:05:45,068 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000002_0 which needs 1 slots
2013-10-31 16:05:45,069 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000003_0 which needs 1 slots
2013-10-31 16:05:45,069 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0002_m_000003_0 which needs 1 slots
2013-10-31 16:05:45,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken	dst=null	perm=null
2013-10-31 16:05:45,074 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33760, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5382160867474461323_1024, duration: 166551
2013-10-31 16:05:45,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml	dst=null	perm=null
2013-10-31 16:05:45,080 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33693, bytes: 27648, op: HDFS_READ, cliID: DFSClient_-994049571, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2999485849396669780_1021, duration: 217457
2013-10-31 16:05:45,097 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:45,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:45,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar	dst=null	perm=null
2013-10-31 16:05:45,114 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46796, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-994049571, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2674703006665761127_1018, duration: 1180074
2013-10-31 16:05:45,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:45,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:45,177 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_88478447
2013-10-31 16:05:45,177 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_88478447 spawned.
2013-10-31 16:05:45,178 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_955433630
2013-10-31 16:05:45,178 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_955433630 spawned.
2013-10-31 16:05:45,180 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000002_0/taskjvm.sh
2013-10-31 16:05:45,180 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000003_0/taskjvm.sh
2013-10-31 16:05:45,291 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000004_0' to tip task_20131031160444934_0002_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:05:45,291 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000004
2013-10-31 16:05:45,292 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:05:45,293 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000004_0 which needs 1 slots
2013-10-31 16:05:45,293 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000004_0 which needs 1 slots
2013-10-31 16:05:45,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken	dst=null	perm=null
2013-10-31 16:05:45,299 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53800, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5382160867474461323_1024, duration: 202450
2013-10-31 16:05:45,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml	dst=null	perm=null
2013-10-31 16:05:45,305 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46799, bytes: 27648, op: HDFS_READ, cliID: DFSClient_946962665, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2999485849396669780_1021, duration: 227598
2013-10-31 16:05:45,320 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:45,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar	dst=null	perm=null
2013-10-31 16:05:45,337 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46800, bytes: 239915, op: HDFS_READ, cliID: DFSClient_946962665, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2674703006665761127_1018, duration: 1166452
2013-10-31 16:05:45,386 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53804, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 157532
2013-10-31 16:05:45,391 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000. blk_-6755368884408234344_1025
2013-10-31 16:05:45,411 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6755368884408234344_1025 src: /127.0.0.1:33769 dest: /127.0.0.1:38271
2013-10-31 16:05:45,460 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6755368884408234344_1025 src: /127.0.0.1:46803 dest: /127.0.0.1:47311
2013-10-31 16:05:45,461 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6755368884408234344_1025 src: /127.0.0.1:53807 dest: /127.0.0.1:41648
2013-10-31 16:05:45,462 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_-541739399
2013-10-31 16:05:45,462 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_-541739399 spawned.
2013-10-31 16:05:45,464 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000004_0/taskjvm.sh
2013-10-31 16:05:45,468 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53807, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6755368884408234344_1025, duration: 6433285
2013-10-31 16:05:45,468 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6755368884408234344_1025 terminating
2013-10-31 16:05:45,469 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46803, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6755368884408234344_1025, duration: 6502398
2013-10-31 16:05:45,469 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6755368884408234344_1025 terminating
2013-10-31 16:05:45,469 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33769, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6755368884408234344_1025, duration: 7123061
2013-10-31 16:05:45,469 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6755368884408234344_1025 terminating
2013-10-31 16:05:45,470 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6755368884408234344_1025 size 92
2013-10-31 16:05:45,471 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6755368884408234344_1025 size 92
2013-10-31 16:05:45,472 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6755368884408234344_1025 size 92
2013-10-31 16:05:45,473 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0002_m_000000_0
2013-10-31 16:05:45,474 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0002_m_000000_0
2013-10-31 16:05:45,714 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_481603449 given task: attempt_20131031160444934_0002_m_000001_0
2013-10-31 16:05:45,852 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:45,853 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000000_0 0.0% 
2013-10-31 16:05:46,243 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_88478447 given task: attempt_20131031160444934_0002_m_000002_0
2013-10-31 16:05:46,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split	dst=null	perm=null
2013-10-31 16:05:46,348 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33706, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_697700709896827018_1019, duration: 235943
2013-10-31 16:05:46,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:46,388 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46809, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 153677
2013-10-31 16:05:46,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:46,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:46,596 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001. blk_-281896601574383084_1026
2013-10-31 16:05:46,616 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_955433630 given task: attempt_20131031160444934_0002_m_000003_0
2013-10-31 16:05:46,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-281896601574383084_1026 src: /127.0.0.1:53815 dest: /127.0.0.1:41648
2013-10-31 16:05:46,620 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-281896601574383084_1026 src: /127.0.0.1:33780 dest: /127.0.0.1:38271
2013-10-31 16:05:46,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-281896601574383084_1026 src: /127.0.0.1:46814 dest: /127.0.0.1:47311
2013-10-31 16:05:46,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46814, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-281896601574383084_1026, duration: 1335395
2013-10-31 16:05:46,623 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-281896601574383084_1026 terminating
2013-10-31 16:05:46,623 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-281896601574383084_1026 size 92
2013-10-31 16:05:46,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33780, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-281896601574383084_1026, duration: 1645916
2013-10-31 16:05:46,624 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-281896601574383084_1026 terminating
2013-10-31 16:05:46,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53815, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-281896601574383084_1026, duration: 2143233
2013-10-31 16:05:46,624 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-281896601574383084_1026 terminating
2013-10-31 16:05:46,625 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0002_m_000001_0
2013-10-31 16:05:46,625 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0002_m_000001_0
2013-10-31 16:05:46,625 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-281896601574383084_1026 size 92
2013-10-31 16:05:46,627 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-281896601574383084_1026 size 92
2013-10-31 16:05:46,677 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:46,677 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000001_0 0.0% 
2013-10-31 16:05:46,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split	dst=null	perm=null
2013-10-31 16:05:46,748 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46816, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_697700709896827018_1019, duration: 216291
2013-10-31 16:05:46,760 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_-541739399 given task: attempt_20131031160444934_0002_m_000004_0
2013-10-31 16:05:46,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:46,787 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53820, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 174499
2013-10-31 16:05:46,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:46,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:46,990 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002. blk_7989246260074545108_1027
2013-10-31 16:05:47,013 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7989246260074545108_1027 src: /127.0.0.1:33785 dest: /127.0.0.1:38271
2013-10-31 16:05:47,014 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7989246260074545108_1027 src: /127.0.0.1:46819 dest: /127.0.0.1:47311
2013-10-31 16:05:47,015 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7989246260074545108_1027 src: /127.0.0.1:53823 dest: /127.0.0.1:41648
2013-10-31 16:05:47,017 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53823, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7989246260074545108_1027, duration: 1403090
2013-10-31 16:05:47,018 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7989246260074545108_1027 terminating
2013-10-31 16:05:47,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46819, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7989246260074545108_1027, duration: 1639278
2013-10-31 16:05:47,018 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7989246260074545108_1027 terminating
2013-10-31 16:05:47,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33785, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7989246260074545108_1027, duration: 2107246
2013-10-31 16:05:47,019 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7989246260074545108_1027 terminating
2013-10-31 16:05:47,020 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7989246260074545108_1027 size 92
2013-10-31 16:05:47,020 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7989246260074545108_1027 size 92
2013-10-31 16:05:47,020 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7989246260074545108_1027 size 92
2013-10-31 16:05:47,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split	dst=null	perm=null
2013-10-31 16:05:47,121 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46822, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_697700709896827018_1019, duration: 211258
2013-10-31 16:05:47,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:47,160 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33721, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 137359
2013-10-31 16:05:47,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:47,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:47,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split	dst=null	perm=null
2013-10-31 16:05:47,256 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33792, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_697700709896827018_1019, duration: 222996
2013-10-31 16:05:47,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:05:47,296 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33724, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 168224
2013-10-31 16:05:47,362 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003. blk_7841801315324419468_1028
2013-10-31 16:05:47,385 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7841801315324419468_1028 src: /127.0.0.1:53830 dest: /127.0.0.1:41648
2013-10-31 16:05:47,386 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7841801315324419468_1028 src: /127.0.0.1:33726 dest: /127.0.0.1:50942
2013-10-31 16:05:47,387 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7841801315324419468_1028 src: /127.0.0.1:46829 dest: /127.0.0.1:47311
2013-10-31 16:05:47,389 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46829, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7841801315324419468_1028, duration: 1331259
2013-10-31 16:05:47,389 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7841801315324419468_1028 terminating
2013-10-31 16:05:47,389 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33726, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7841801315324419468_1028, duration: 1501622
2013-10-31 16:05:47,390 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7841801315324419468_1028 terminating
2013-10-31 16:05:47,390 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53830, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7841801315324419468_1028, duration: 2085259
2013-10-31 16:05:47,390 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7841801315324419468_1028 terminating
2013-10-31 16:05:47,391 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7841801315324419468_1028 size 92
2013-10-31 16:05:47,393 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7841801315324419468_1028 size 92
2013-10-31 16:05:47,393 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7841801315324419468_1028 size 92
2013-10-31 16:05:47,420 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0002_m_000002_0
2013-10-31 16:05:47,421 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0002_m_000002_0
2013-10-31 16:05:47,727 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000000_0
2013-10-31 16:05:47,727 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000001_0
2013-10-31 16:05:47,792 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0002_m_000003_0
2013-10-31 16:05:47,793 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0002_m_000003_0
2013-10-31 16:05:47,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0	dst=null	perm=null
2013-10-31 16:05:47,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:48,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0	dst=null	perm=null
2013-10-31 16:05:48,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:48,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:48,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:48,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:48,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0	dst=null	perm=null
2013-10-31 16:05:48,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0	dst=null	perm=null
2013-10-31 16:05:48,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:48,879 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:48,879 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000002_0 0.0% 
2013-10-31 16:05:48,880 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:48,880 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000003_0 0.0% 
2013-10-31 16:05:49,032 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004. blk_-4456889479922960183_1029
2013-10-31 16:05:49,055 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4456889479922960183_1029 src: /127.0.0.1:53833 dest: /127.0.0.1:41648
2013-10-31 16:05:49,056 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4456889479922960183_1029 src: /127.0.0.1:33729 dest: /127.0.0.1:50942
2013-10-31 16:05:49,057 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4456889479922960183_1029 src: /127.0.0.1:46832 dest: /127.0.0.1:47311
2013-10-31 16:05:49,059 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46832, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4456889479922960183_1029, duration: 1144689
2013-10-31 16:05:49,059 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4456889479922960183_1029 terminating
2013-10-31 16:05:49,059 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33729, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4456889479922960183_1029, duration: 1520351
2013-10-31 16:05:49,060 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4456889479922960183_1029 terminating
2013-10-31 16:05:49,060 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53833, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4456889479922960183_1029, duration: 2033088
2013-10-31 16:05:49,060 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4456889479922960183_1029 terminating
2013-10-31 16:05:49,061 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4456889479922960183_1029 size 92
2013-10-31 16:05:49,061 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0002_m_000004_0
2013-10-31 16:05:49,061 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0002_m_000004_0
2013-10-31 16:05:49,062 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4456889479922960183_1029 size 92
2013-10-31 16:05:49,063 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4456889479922960183_1029 size 92
2013-10-31 16:05:49,116 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:49,116 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000004_0 0.0% 
2013-10-31 16:05:49,268 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:05:49,270 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000001_0 is done.
2013-10-31 16:05:49,271 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000001_0  was -1
2013-10-31 16:05:49,271 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:05:49,663 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8580097153134000137_1001
2013-10-31 16:05:49,723 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0002_m_000006_0
2013-10-31 16:05:49,723 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0002_m_000006_0
2013-10-31 16:05:49,724 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000006_0 not found in cache
2013-10-31 16:05:50,731 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000001_0' has completed task_20131031160444934_0002_m_000001 successfully.
2013-10-31 16:05:51,071 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:05:51,075 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:05:51,076 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000000_0 is done.
2013-10-31 16:05:51,076 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000000_0  was -1
2013-10-31 16:05:51,076 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:51,076 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000002_0
2013-10-31 16:05:51,077 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000003_0
2013-10-31 16:05:51,298 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000004_0
2013-10-31 16:05:51,890 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0	dst=null	perm=null
2013-10-31 16:05:51,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0	dst=null	perm=null
2013-10-31 16:05:51,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:51,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:51,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:51,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:51,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0	dst=null	perm=null
2013-10-31 16:05:51,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0	dst=null	perm=null
2013-10-31 16:05:52,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0	dst=null	perm=null
2013-10-31 16:05:52,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:52,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004	dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:52,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0	dst=null	perm=null
2013-10-31 16:05:52,728 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:05:52,730 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:05:52,731 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000002_0 is done.
2013-10-31 16:05:52,732 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000002_0  was -1
2013-10-31 16:05:52,732 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:05:53,091 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:05:53,094 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:05:53,095 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000003_0 is done.
2013-10-31 16:05:53,095 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000003_0  was -1
2013-10-31 16:05:53,095 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:53,231 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:05:53,234 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:05:53,235 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000004_0 is done.
2013-10-31 16:05:53,235 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000004_0  was -1
2013-10-31 16:05:53,236 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:53,876 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000000_0' has completed task_20131031160444934_0002_m_000000 successfully.
2013-10-31 16:05:54,121 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000002_0' has completed task_20131031160444934_0002_m_000002 successfully.
2013-10-31 16:05:54,123 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000003_0' has completed task_20131031160444934_0002_m_000003 successfully.
2013-10-31 16:05:54,304 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000004_0' has completed task_20131031160444934_0002_m_000004 successfully.
2013-10-31 16:05:54,309 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0002_m_000005_0' to tip task_20131031160444934_0002_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:05:54,311 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:05:54,311 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000005_0 which needs 1 slots
2013-10-31 16:05:54,312 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000005_0 which needs 1 slots
2013-10-31 16:05:54,353 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_266027598
2013-10-31 16:05:54,354 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_266027598 spawned.
2013-10-31 16:05:54,356 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000005_0/taskjvm.sh
2013-10-31 16:05:55,168 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_266027598 given task: attempt_20131031160444934_0002_m_000005_0
2013-10-31 16:05:55,697 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000005_0 0.0% 
2013-10-31 16:05:55,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary	dst=null	perm=null
2013-10-31 16:05:55,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:55,722 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_SUCCESS from client DFSClient_attempt_20131031160444934_0002_m_000005_0
2013-10-31 16:05:55,722 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0002_m_000005_0
2013-10-31 16:05:55,730 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2674703006665761127 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:55,730 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2674703006665761127 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:55,731 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2674703006665761127 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:55,731 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2674703006665761127 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:55,731 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_697700709896827018 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:55,731 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_697700709896827018 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:55,731 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_697700709896827018 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:55,732 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_697700709896827018 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:55,732 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2325358903431004453 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:55,732 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2325358903431004453 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:55,732 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2325358903431004453 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:55,732 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2999485849396669780 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:55,733 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2999485849396669780 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:55,733 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2999485849396669780 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:55,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002	dst=null	perm=null
2013-10-31 16:05:57,154 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_697700709896827018_1019 blk_-2674703006665761127_1018
2013-10-31 16:05:57,154 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_697700709896827018_1019 blk_-2999485849396669780_1021 blk_-2325358903431004453_1020 blk_-2674703006665761127_1018
2013-10-31 16:05:57,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2999485849396669780_1021 file build/test/data/dfs/data/data3/current/blk_-2999485849396669780 for deletion
2013-10-31 16:05:57,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2674703006665761127_1018 file build/test/data/dfs/data/data4/current/blk_-2674703006665761127 for deletion
2013-10-31 16:05:57,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2999485849396669780_1021 at file build/test/data/dfs/data/data3/current/blk_-2999485849396669780
2013-10-31 16:05:57,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2325358903431004453_1020 file build/test/data/dfs/data/data4/current/blk_-2325358903431004453 for deletion
2013-10-31 16:05:57,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_697700709896827018_1019 file build/test/data/dfs/data/data3/current/blk_697700709896827018 for deletion
2013-10-31 16:05:57,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2674703006665761127_1018 at file build/test/data/dfs/data/data4/current/blk_-2674703006665761127
2013-10-31 16:05:57,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_697700709896827018_1019 at file build/test/data/dfs/data/data3/current/blk_697700709896827018
2013-10-31 16:05:57,236 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2325358903431004453_1020 at file build/test/data/dfs/data/data4/current/blk_-2325358903431004453
2013-10-31 16:05:58,608 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000005_0 0.0% cleanup
2013-10-31 16:05:58,609 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000005_0 is done.
2013-10-31 16:05:58,610 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000005_0  was -1
2013-10-31 16:05:58,610 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:59,648 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2674703006665761127_1018 file build/test/data/dfs/data/data2/current/blk_-2674703006665761127 for deletion
2013-10-31 16:05:59,649 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_697700709896827018_1019 file build/test/data/dfs/data/data1/current/blk_697700709896827018 for deletion
2013-10-31 16:05:59,649 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2674703006665761127_1018 at file build/test/data/dfs/data/data2/current/blk_-2674703006665761127
2013-10-31 16:05:59,649 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_697700709896827018_1019 at file build/test/data/dfs/data/data1/current/blk_697700709896827018
2013-10-31 16:06:00,155 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_697700709896827018_1019 blk_-2999485849396669780_1021 blk_-2325358903431004453_1020 blk_-2674703006665761127_1018
2013-10-31 16:06:00,155 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_697700709896827018_1019 blk_-2999485849396669780_1021 blk_-2325358903431004453_1020 blk_-2674703006665761127_1018
2013-10-31 16:06:00,321 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000005_0' has completed task_20131031160444934_0002_m_000005 successfully.
2013-10-31 16:06:00,323 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0002 has completed successfully.
2013-10-31 16:06:00,323 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0002,submitTime=1383235536530,launchTime=1383235537705,firstMapTaskLaunchTime=1383235544716,firstJobSetupTaskLaunchTime=1383235538696,firstJobCleanupTaskLaunchTime=1383235554309,finishTime=1383235560323,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=43,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[4D6DBE4C00904663A16DE2E5B8D6F5BD/4DB0B02E157744A581DC8E096E64C231] upper1*upper2*lower/(2/2)
2013-10-31 16:06:00,331 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5. blk_-685171818103965493_1030
2013-10-31 16:06:00,333 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-685171818103965493_1030 src: /127.0.0.1:33735 dest: /127.0.0.1:50942
2013-10-31 16:06:00,335 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-685171818103965493_1030 src: /127.0.0.1:33805 dest: /127.0.0.1:38271
2013-10-31 16:06:00,337 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-685171818103965493_1030 src: /127.0.0.1:53842 dest: /127.0.0.1:41648
2013-10-31 16:06:00,346 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53842, dest: /127.0.0.1:41648, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-685171818103965493_1030, duration: 4357057
2013-10-31 16:06:00,346 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-685171818103965493_1030 terminating
2013-10-31 16:06:00,347 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33805, dest: /127.0.0.1:38271, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-685171818103965493_1030, duration: 4267498
2013-10-31 16:06:00,347 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-685171818103965493_1030 terminating
2013-10-31 16:06:00,348 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33735, dest: /127.0.0.1:50942, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-685171818103965493_1030, duration: 7219814
2013-10-31 16:06:00,348 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-685171818103965493_1030 size 26337
2013-10-31 16:06:00,348 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-685171818103965493_1030 terminating
2013-10-31 16:06:00,352 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-685171818103965493_1030 size 26337
2013-10-31 16:06:00,353 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-685171818103965493_1030 size 26337
2013-10-31 16:06:00,353 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5 from client DFSClient_-1555598147
2013-10-31 16:06:00,354 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5 is closed by DFSClient_-1555598147
2013-10-31 16:06:00,367 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:00,371 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000004_0'
2013-10-31 16:06:00,371 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000005_0'
2013-10-31 16:06:00,373 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5382160867474461323 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:00,373 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5382160867474461323 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:00,373 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5382160867474461323 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:00,378 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0002_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:00,378 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper1*upper2*lower] starting step: (1/2) ...rm/joinaroundjoinleftmost
2013-10-31 16:06:00,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002	dst=null	perm=null
2013-10-31 16:06:00,389 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:06:00,389 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:06:00,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:00,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:06:00,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,844 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar. blk_-205831684819831428_1031
2013-10-31 16:06:00,845 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-205831684819831428_1031 src: /127.0.0.1:33740 dest: /127.0.0.1:50942
2013-10-31 16:06:00,846 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-205831684819831428_1031 src: /127.0.0.1:53846 dest: /127.0.0.1:41648
2013-10-31 16:06:00,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-205831684819831428_1031 src: /127.0.0.1:46844 dest: /127.0.0.1:47311
2013-10-31 16:06:00,857 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46844, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-205831684819831428_1031, duration: 8839858
2013-10-31 16:06:00,857 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-205831684819831428_1031 terminating
2013-10-31 16:06:00,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53846, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-205831684819831428_1031, duration: 8087078
2013-10-31 16:06:00,858 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-205831684819831428_1031 terminating
2013-10-31 16:06:00,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33740, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-205831684819831428_1031, duration: 9914028
2013-10-31 16:06:00,859 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-205831684819831428_1031 terminating
2013-10-31 16:06:00,862 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-205831684819831428_1031 size 238055
2013-10-31 16:06:00,862 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar from client DFSClient_1457307213
2013-10-31 16:06:00,862 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar is closed by DFSClient_1457307213
2013-10-31 16:06:00,862 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-205831684819831428_1031 size 238055
2013-10-31 16:06:00,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2999485849396669780_1021 file build/test/data/dfs/data/data6/current/blk_-2999485849396669780 for deletion
2013-10-31 16:06:00,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2674703006665761127_1018 file build/test/data/dfs/data/data5/current/blk_-2674703006665761127 for deletion
2013-10-31 16:06:00,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2325358903431004453_1020 file build/test/data/dfs/data/data5/current/blk_-2325358903431004453 for deletion
2013-10-31 16:06:00,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2999485849396669780_1021 at file build/test/data/dfs/data/data6/current/blk_-2999485849396669780
2013-10-31 16:06:00,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2674703006665761127_1018 at file build/test/data/dfs/data/data5/current/blk_-2674703006665761127
2013-10-31 16:06:00,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_697700709896827018_1019 file build/test/data/dfs/data/data6/current/blk_697700709896827018 for deletion
2013-10-31 16:06:00,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2325358903431004453_1020 at file build/test/data/dfs/data/data5/current/blk_-2325358903431004453
2013-10-31 16:06:00,864 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_697700709896827018_1019 at file build/test/data/dfs/data/data6/current/blk_697700709896827018
2013-10-31 16:06:00,864 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-205831684819831428_1031 size 238055
2013-10-31 16:06:00,869 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar. New replication is 10
2013-10-31 16:06:00,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar	dst=null	perm=null
2013-10-31 16:06:00,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,882 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:06:00,888 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:06:00,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:00,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,909 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split. New replication is 10
2013-10-31 16:06:00,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split	dst=null	perm=null
2013-10-31 16:06:00,920 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split. blk_-7021115318436035076_1032
2013-10-31 16:06:00,962 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021115318436035076_1032 src: /127.0.0.1:33812 dest: /127.0.0.1:38271
2013-10-31 16:06:00,963 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021115318436035076_1032 src: /127.0.0.1:46846 dest: /127.0.0.1:47311
2013-10-31 16:06:00,964 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021115318436035076_1032 src: /127.0.0.1:33745 dest: /127.0.0.1:50942
2013-10-31 16:06:00,965 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021115318436035076_1032 src: /127.0.0.1:53851 dest: /127.0.0.1:41648
2013-10-31 16:06:00,966 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53851, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7021115318436035076_1032, duration: 160087
2013-10-31 16:06:00,967 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7021115318436035076_1032 terminating
2013-10-31 16:06:00,967 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33745, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7021115318436035076_1032, duration: 1017596
2013-10-31 16:06:00,967 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7021115318436035076_1032 terminating
2013-10-31 16:06:00,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46846, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7021115318436035076_1032, duration: 1398809
2013-10-31 16:06:00,969 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7021115318436035076_1032 terminating
2013-10-31 16:06:00,972 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33812, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7021115318436035076_1032, duration: 6110073
2013-10-31 16:06:00,973 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7021115318436035076_1032 size 1732
2013-10-31 16:06:00,974 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7021115318436035076_1032 terminating
2013-10-31 16:06:00,975 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7021115318436035076_1032 size 1732
2013-10-31 16:06:00,975 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7021115318436035076_1032 size 1732
2013-10-31 16:06:00,975 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split from client DFSClient_1457307213
2013-10-31 16:06:00,976 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split is closed by DFSClient_1457307213
2013-10-31 16:06:00,977 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7021115318436035076_1032 size 1732
2013-10-31 16:06:00,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,991 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo. blk_-1293847835140075373_1033
2013-10-31 16:06:00,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1293847835140075373_1033 src: /127.0.0.1:33816 dest: /127.0.0.1:38271
2013-10-31 16:06:00,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1293847835140075373_1033 src: /127.0.0.1:46850 dest: /127.0.0.1:47311
2013-10-31 16:06:00,995 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1293847835140075373_1033 src: /127.0.0.1:53854 dest: /127.0.0.1:41648
2013-10-31 16:06:00,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53854, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1293847835140075373_1033, duration: 32783
2013-10-31 16:06:00,997 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1293847835140075373_1033 terminating
2013-10-31 16:06:00,998 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46850, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1293847835140075373_1033, duration: 500344
2013-10-31 16:06:00,998 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1293847835140075373_1033 terminating
2013-10-31 16:06:00,999 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33816, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1293847835140075373_1033, duration: 1437594
2013-10-31 16:06:01,000 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1293847835140075373_1033 terminating
2013-10-31 16:06:01,001 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1293847835140075373_1033 size 183
2013-10-31 16:06:01,001 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1293847835140075373_1033 size 183
2013-10-31 16:06:01,001 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:06:01,002 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:06:01,003 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1293847835140075373_1033 size 183
2013-10-31 16:06:01,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:01,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:01,028 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml. blk_1007983707836522264_1034
2013-10-31 16:06:01,030 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1007983707836522264_1034 src: /127.0.0.1:46852 dest: /127.0.0.1:47311
2013-10-31 16:06:01,031 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1007983707836522264_1034 src: /127.0.0.1:33820 dest: /127.0.0.1:38271
2013-10-31 16:06:01,032 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1007983707836522264_1034 src: /127.0.0.1:53857 dest: /127.0.0.1:41648
2013-10-31 16:06:01,034 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53857, dest: /127.0.0.1:41648, bytes: 29360, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1007983707836522264_1034, duration: 1282323
2013-10-31 16:06:01,034 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1007983707836522264_1034 terminating
2013-10-31 16:06:01,035 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33820, dest: /127.0.0.1:38271, bytes: 29360, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1007983707836522264_1034, duration: 1465786
2013-10-31 16:06:01,035 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1007983707836522264_1034 terminating
2013-10-31 16:06:01,035 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46852, dest: /127.0.0.1:47311, bytes: 29360, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1007983707836522264_1034, duration: 1611685
2013-10-31 16:06:01,036 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1007983707836522264_1034 terminating
2013-10-31 16:06:01,037 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1007983707836522264_1034 size 29360
2013-10-31 16:06:01,038 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1007983707836522264_1034 size 29360
2013-10-31 16:06:01,038 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1007983707836522264_1034 size 29360
2013-10-31 16:06:01,199 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0002
2013-10-31 16:06:01,200 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0002 being deleted.
2013-10-31 16:06:01,438 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml from client DFSClient_1457307213
2013-10-31 16:06:01,438 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml is closed by DFSClient_1457307213
2013-10-31 16:06:01,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml	dst=null	perm=null
2013-10-31 16:06:01,457 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46856, bytes: 29592, op: HDFS_READ, cliID: DFSClient_954571228, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1007983707836522264_1034, duration: 524167
2013-10-31 16:06:01,473 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0003: nMaps=5 nReduces=0 max=-1
2013-10-31 16:06:01,475 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0003 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:06:01,475 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0003	RESULT=SUCCESS
2013-10-31 16:06:01,475 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0003
2013-10-31 16:06:01,475 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0003
2013-10-31 16:06:01,476 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper1*upper2*lower] submitted hadoop job: job_20131031160444934_0003
2013-10-31 16:06:01,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:01,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:01,980 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_conf.xml. blk_2131819952922363396_1036
2013-10-31 16:06:01,981 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2131819952922363396_1036 src: /127.0.0.1:33755 dest: /127.0.0.1:50942
2013-10-31 16:06:01,982 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2131819952922363396_1036 src: /127.0.0.1:33825 dest: /127.0.0.1:38271
2013-10-31 16:06:01,983 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2131819952922363396_1036 src: /127.0.0.1:46859 dest: /127.0.0.1:47311
2013-10-31 16:06:01,992 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46859, dest: /127.0.0.1:47311, bytes: 29425, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2131819952922363396_1036, duration: 38043
2013-10-31 16:06:01,992 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2131819952922363396_1036 terminating
2013-10-31 16:06:01,992 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33825, dest: /127.0.0.1:38271, bytes: 29425, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2131819952922363396_1036, duration: 1332664
2013-10-31 16:06:01,993 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2131819952922363396_1036 terminating
2013-10-31 16:06:01,993 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33755, dest: /127.0.0.1:50942, bytes: 29425, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2131819952922363396_1036, duration: 1680713
2013-10-31 16:06:01,994 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2131819952922363396_1036 terminating
2013-10-31 16:06:01,996 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2131819952922363396_1036 size 29425
2013-10-31 16:06:01,996 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_conf.xml from client DFSClient_954571228
2013-10-31 16:06:01,997 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_conf.xml is closed by DFSClient_954571228
2013-10-31 16:06:01,997 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2131819952922363396_1036 size 29425
2013-10-31 16:06:01,997 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2131819952922363396_1036 size 29425
2013-10-31 16:06:02,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:02,010 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken. blk_6141873193401928131_1037
2013-10-31 16:06:02,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6141873193401928131_1037 src: /127.0.0.1:33758 dest: /127.0.0.1:50942
2013-10-31 16:06:02,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6141873193401928131_1037 src: /127.0.0.1:53864 dest: /127.0.0.1:41648
2013-10-31 16:06:02,012 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6141873193401928131_1037 src: /127.0.0.1:46862 dest: /127.0.0.1:47311
2013-10-31 16:06:02,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46862, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6141873193401928131_1037, duration: 29976
2013-10-31 16:06:02,013 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6141873193401928131_1037 terminating
2013-10-31 16:06:02,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53864, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6141873193401928131_1037, duration: 400624
2013-10-31 16:06:02,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6141873193401928131_1037 terminating
2013-10-31 16:06:02,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33758, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6141873193401928131_1037, duration: 761176
2013-10-31 16:06:02,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6141873193401928131_1037 terminating
2013-10-31 16:06:02,015 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6141873193401928131_1037 size 116
2013-10-31 16:06:02,016 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6141873193401928131_1037 size 116
2013-10-31 16:06:02,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6141873193401928131_1037 size 116
2013-10-31 16:06:02,416 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken from client DFSClient_1457307213
2013-10-31 16:06:02,417 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken is closed by DFSClient_1457307213
2013-10-31 16:06:02,422 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken
2013-10-31 16:06:02,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:06:02,428 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46863, bytes: 187, op: HDFS_READ, cliID: DFSClient_954571228, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1293847835140075373_1033, duration: 355972
2013-10-31 16:06:02,431 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0003 = 19. Number of splits = 5
2013-10-31 16:06:02,432 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,432 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,432 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,432 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,433 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,433 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,433 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,433 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,435 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,435 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,435 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0003 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:06:02,436 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0003 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:06:02,851 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2999485849396669780_1021 file build/test/data/dfs/data/data7/current/blk_-2999485849396669780 for deletion
2013-10-31 16:06:02,851 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2674703006665761127_1018 file build/test/data/dfs/data/data8/current/blk_-2674703006665761127 for deletion
2013-10-31 16:06:02,851 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2999485849396669780_1021 at file build/test/data/dfs/data/data7/current/blk_-2999485849396669780
2013-10-31 16:06:02,852 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2325358903431004453_1020 file build/test/data/dfs/data/data8/current/blk_-2325358903431004453 for deletion
2013-10-31 16:06:02,852 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2674703006665761127_1018 at file build/test/data/dfs/data/data8/current/blk_-2674703006665761127
2013-10-31 16:06:02,852 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_697700709896827018_1019 file build/test/data/dfs/data/data7/current/blk_697700709896827018 for deletion
2013-10-31 16:06:02,852 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2325358903431004453_1020 at file build/test/data/dfs/data/data8/current/blk_-2325358903431004453
2013-10-31 16:06:02,853 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_697700709896827018_1019 at file build/test/data/dfs/data/data7/current/blk_697700709896827018
2013-10-31 16:06:03,133 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0003_m_000006_0' to tip task_20131031160444934_0003_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:03,138 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000000_0'
2013-10-31 16:06:03,138 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000001_0'
2013-10-31 16:06:03,138 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000006_0'
2013-10-31 16:06:03,141 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000002_0'
2013-10-31 16:06:03,142 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:06:03,142 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000003_0'
2013-10-31 16:06:03,142 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000006_0 which needs 1 slots
2013-10-31 16:06:03,143 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000006_0 which needs 1 slots
2013-10-31 16:06:03,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken	dst=null	perm=null
2013-10-31 16:06:03,154 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53867, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6141873193401928131_1037, duration: 373823
2013-10-31 16:06:03,156 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-205831684819831428_1031 to datanode(s) 127.0.0.1:38271
2013-10-31 16:06:03,157 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5382160867474461323_1024
2013-10-31 16:06:03,157 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-5382160867474461323_1024
2013-10-31 16:06:03,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml	dst=null	perm=null
2013-10-31 16:06:03,169 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46866, bytes: 29592, op: HDFS_READ, cliID: DFSClient_2118860654, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1007983707836522264_1034, duration: 488157
2013-10-31 16:06:03,202 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:03,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar	dst=null	perm=null
2013-10-31 16:06:03,242 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33765, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2118860654, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-205831684819831428_1031, duration: 2525559
2013-10-31 16:06:03,353 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0002_m_1252934869
2013-10-31 16:06:03,361 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10457 with signal TERM. Exit code 0
2013-10-31 16:06:03,361 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_-978688131
2013-10-31 16:06:03,362 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_-978688131 spawned.
2013-10-31 16:06:03,364 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000006_0/taskjvm.sh
2013-10-31 16:06:03,614 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0002_m_1252934869
2013-10-31 16:06:03,802 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:03,802 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:03,802 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:03,802 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_1252934869 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:06:04,538 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-978688131 given task: attempt_20131031160444934_0003_m_000006_0
2013-10-31 16:06:05,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:05,373 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0002
2013-10-31 16:06:05,373 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000005_0 not found in cache
2013-10-31 16:06:05,374 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000004_0 not found in cache
2013-10-31 16:06:05,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0002 for user-log deletion with retainTimeStamp:1383321965376
2013-10-31 16:06:05,650 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5382160867474461323_1024 file build/test/data/dfs/data/data1/current/blk_-5382160867474461323 for deletion
2013-10-31 16:06:05,651 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5382160867474461323_1024 at file build/test/data/dfs/data/data1/current/blk_-5382160867474461323
2013-10-31 16:06:05,777 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0002_m_-541739399 since job job_20131031160444934_0002 is dead
2013-10-31 16:06:05,787 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10765 with signal TERM. Exit code 0
2013-10-31 16:06:05,852 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-205831684819831428_1031 to 127.0.0.1:38271 
2013-10-31 16:06:05,852 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5382160867474461323_1024 file build/test/data/dfs/data/data7/current/blk_-5382160867474461323 for deletion
2013-10-31 16:06:05,853 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5382160867474461323_1024 at file build/test/data/dfs/data/data7/current/blk_-5382160867474461323
2013-10-31 16:06:05,854 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-205831684819831428_1031 src: /127.0.0.1:33837 dest: /127.0.0.1:38271
2013-10-31 16:06:05,855 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-205831684819831428_1031 to /127.0.0.1:38271
2013-10-31 16:06:05,855 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-205831684819831428_1031 src: /127.0.0.1:33837 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:06:05,860 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-205831684819831428_1031 size 238055
2013-10-31 16:06:05,968 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:05,968 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:05,968 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:05,968 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_-541739399 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:06,158 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-5382160867474461323_1024
2013-10-31 16:06:06,675 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0002_m_266027598 since job job_20131031160444934_0002 is dead
2013-10-31 16:06:06,685 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10938 with signal TERM. Exit code 0
2013-10-31 16:06:06,838 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:06,839 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:06,839 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:06,839 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_266027598 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:06,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5382160867474461323_1024 file build/test/data/dfs/data/data6/current/blk_-5382160867474461323 for deletion
2013-10-31 16:06:06,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5382160867474461323_1024 at file build/test/data/dfs/data/data6/current/blk_-5382160867474461323
2013-10-31 16:06:07,952 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000006_0 0.0% setup
2013-10-31 16:06:07,955 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000006_0 is done.
2013-10-31 16:06:07,956 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000006_0  was -1
2013-10-31 16:06:07,956 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:08,143 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0002
2013-10-31 16:06:08,143 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000001_0 not found in cache
2013-10-31 16:06:08,143 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0002
2013-10-31 16:06:08,143 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000000_0 not found in cache
2013-10-31 16:06:08,144 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000002_0 not found in cache
2013-10-31 16:06:08,144 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000003_0 not found in cache
2013-10-31 16:06:08,144 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0002 for user-log deletion with retainTimeStamp:1383321968144
2013-10-31 16:06:08,145 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0002 for user-log deletion with retainTimeStamp:1383321968144
2013-10-31 16:06:08,281 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0002_m_88478447 since job job_20131031160444934_0002 is dead
2013-10-31 16:06:08,291 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10688 with signal TERM. Exit code 0
2013-10-31 16:06:08,488 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:08,489 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:08,489 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:08,489 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_88478447 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:08,639 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0002_m_955433630 since job job_20131031160444934_0002 is dead
2013-10-31 16:06:08,649 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10727 with signal TERM. Exit code 0
2013-10-31 16:06:08,842 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:08,842 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:08,842 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:08,842 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_955433630 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:09,150 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000006_0' has completed task_20131031160444934_0003_m_000006 successfully.
2013-10-31 16:06:09,153 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000000_0' to tip task_20131031160444934_0003_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:09,154 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000000
2013-10-31 16:06:09,154 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000001_0' to tip task_20131031160444934_0003_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:09,155 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000001
2013-10-31 16:06:09,157 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000002_0' to tip task_20131031160444934_0003_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:09,157 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:06:09,158 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000002
2013-10-31 16:06:09,158 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:06:09,158 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000003_0' to tip task_20131031160444934_0003_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:09,158 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000000_0 which needs 1 slots
2013-10-31 16:06:09,159 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000000_0 which needs 1 slots
2013-10-31 16:06:09,159 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000003
2013-10-31 16:06:09,159 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000001_0 which needs 1 slots
2013-10-31 16:06:09,159 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0003_m_000001_0 which needs 1 slots
2013-10-31 16:06:09,164 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:06:09,166 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:06:09,167 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000002_0 which needs 1 slots
2013-10-31 16:06:09,167 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000002_0 which needs 1 slots
2013-10-31 16:06:09,167 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000003_0 which needs 1 slots
2013-10-31 16:06:09,167 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0003_m_000003_0 which needs 1 slots
2013-10-31 16:06:09,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken	dst=null	perm=null
2013-10-31 16:06:09,180 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46871, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6141873193401928131_1037, duration: 350373
2013-10-31 16:06:09,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml	dst=null	perm=null
2013-10-31 16:06:09,190 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0003/attempt_20131031160444934_0003_m_000001_0. Attempting to reuse: jvm_20131031160444934_0003_m_-978688131
2013-10-31 16:06:09,191 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0002_m_481603449
2013-10-31 16:06:09,194 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46873, bytes: 29592, op: HDFS_READ, cliID: DFSClient_-2056367726, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1007983707836522264_1034, duration: 571929
2013-10-31 16:06:09,196 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10599 with signal TERM. Exit code 0
2013-10-31 16:06:09,197 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_-2067127539
2013-10-31 16:06:09,198 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_-2067127539 spawned.
2013-10-31 16:06:09,200 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000000_0/taskjvm.sh
2013-10-31 16:06:09,270 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:09,277 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:09,277 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:09,277 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:09,277 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_481603449 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:09,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar	dst=null	perm=null
2013-10-31 16:06:09,295 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53877, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2056367726, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-205831684819831428_1031, duration: 1209882
2013-10-31 16:06:09,360 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_-1219933498
2013-10-31 16:06:09,361 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_-1219933498 spawned.
2013-10-31 16:06:09,361 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_-1716222122
2013-10-31 16:06:09,362 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_-1716222122 spawned.
2013-10-31 16:06:09,362 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000003_0/taskjvm.sh
2013-10-31 16:06:09,363 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000002_0/taskjvm.sh
2013-10-31 16:06:09,382 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000004_0' to tip task_20131031160444934_0003_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:06:09,382 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000004
2013-10-31 16:06:09,384 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:06:09,385 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000004_0 which needs 1 slots
2013-10-31 16:06:09,385 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000004_0 which needs 1 slots
2013-10-31 16:06:09,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken	dst=null	perm=null
2013-10-31 16:06:09,389 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46875, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6141873193401928131_1037, duration: 158850
2013-10-31 16:06:09,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml	dst=null	perm=null
2013-10-31 16:06:09,395 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33844, bytes: 29592, op: HDFS_READ, cliID: DFSClient_908427599, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1007983707836522264_1034, duration: 203728
2013-10-31 16:06:09,409 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:09,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar	dst=null	perm=null
2013-10-31 16:06:09,429 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46878, bytes: 239915, op: HDFS_READ, cliID: DFSClient_908427599, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-205831684819831428_1031, duration: 1188757
2013-10-31 16:06:09,519 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-978688131 given task: attempt_20131031160444934_0003_m_000001_0
2013-10-31 16:06:09,549 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_398315277
2013-10-31 16:06:09,551 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_398315277 spawned.
2013-10-31 16:06:09,553 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000004_0/taskjvm.sh
2013-10-31 16:06:09,863 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8580097153134000137_1001
2013-10-31 16:06:10,083 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-2067127539 given task: attempt_20131031160444934_0003_m_000000_0
2013-10-31 16:06:10,332 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-1219933498 given task: attempt_20131031160444934_0003_m_000003_0
2013-10-31 16:06:10,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split	dst=null	perm=null
2013-10-31 16:06:10,587 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33849, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7021115318436035076_1032, duration: 251073
2013-10-31 16:06:10,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:10,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split	dst=null	perm=null
2013-10-31 16:06:10,844 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33851, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7021115318436035076_1032, duration: 286595
2013-10-31 16:06:10,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:10,885 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46885, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 312235
2013-10-31 16:06:11,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:11,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:11,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:11,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:11,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split	dst=null	perm=null
2013-10-31 16:06:11,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33785, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7021115318436035076_1032, duration: 213144
2013-10-31 16:06:11,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:11,198 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46888, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 158608
2013-10-31 16:06:11,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:11,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:11,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=null
2013-10-31 16:06:11,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:11,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:11,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:11,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:11,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:11,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:11,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=null
2013-10-31 16:06:11,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53892, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6755368884408234344_1025, duration: 146284
2013-10-31 16:06:11,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:11,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:11,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:11,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:11,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:11,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:11,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:11,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33857, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6755368884408234344_1025, duration: 161980
2013-10-31 16:06:11,374 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33858, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-281896601574383084_1026, duration: 132979
2013-10-31 16:06:11,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:11,377 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33859, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7989246260074545108_1027, duration: 118450
2013-10-31 16:06:11,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:11,380 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33791, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7841801315324419468_1028, duration: 118944
2013-10-31 16:06:11,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:11,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46894, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4456889479922960183_1029, duration: 117287
2013-10-31 16:06:11,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:11,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:11,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:11,389 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33793, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 121635
2013-10-31 16:06:11,391 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46896, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-281896601574383084_1026, duration: 127200
2013-10-31 16:06:11,392 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46897, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 117358
2013-10-31 16:06:11,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:11,394 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53901, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7989246260074545108_1027, duration: 126591
2013-10-31 16:06:11,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:11,398 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53902, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7841801315324419468_1028, duration: 204448
2013-10-31 16:06:11,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:11,403 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46900, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4456889479922960183_1029, duration: 152320
2013-10-31 16:06:11,404 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000. blk_-8753219517823030001_1040
2013-10-31 16:06:11,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:11,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:11,410 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33869, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 128548
2013-10-31 16:06:11,419 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003. blk_4031594352087008341_1040
2013-10-31 16:06:11,439 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8753219517823030001_1040 src: /127.0.0.1:33868 dest: /127.0.0.1:38271
2013-10-31 16:06:11,440 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8753219517823030001_1040 src: /127.0.0.1:53907 dest: /127.0.0.1:41648
2013-10-31 16:06:11,440 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8753219517823030001_1040 src: /127.0.0.1:46905 dest: /127.0.0.1:47311
2013-10-31 16:06:11,443 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46905, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8753219517823030001_1040, duration: 1762018
2013-10-31 16:06:11,443 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8753219517823030001_1040 terminating
2013-10-31 16:06:11,443 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53907, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8753219517823030001_1040, duration: 2108970
2013-10-31 16:06:11,443 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8753219517823030001_1040 terminating
2013-10-31 16:06:11,444 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33868, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8753219517823030001_1040, duration: 2423196
2013-10-31 16:06:11,444 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8753219517823030001_1040 terminating
2013-10-31 16:06:11,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4031594352087008341_1040 src: /127.0.0.1:33801 dest: /127.0.0.1:50942
2013-10-31 16:06:11,445 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8753219517823030001_1040 size 12
2013-10-31 16:06:11,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4031594352087008341_1040 src: /127.0.0.1:33873 dest: /127.0.0.1:38271
2013-10-31 16:06:11,446 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4031594352087008341_1040 src: /127.0.0.1:53910 dest: /127.0.0.1:41648
2013-10-31 16:06:11,447 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8753219517823030001_1040 size 12
2013-10-31 16:06:11,447 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8753219517823030001_1040 size 12
2013-10-31 16:06:11,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53910, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4031594352087008341_1040, duration: 1529782
2013-10-31 16:06:11,449 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4031594352087008341_1040 terminating
2013-10-31 16:06:11,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33873, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4031594352087008341_1040, duration: 1892427
2013-10-31 16:06:11,449 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4031594352087008341_1040 terminating
2013-10-31 16:06:11,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33801, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4031594352087008341_1040, duration: 2242040
2013-10-31 16:06:11,450 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4031594352087008341_1040 terminating
2013-10-31 16:06:11,450 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4031594352087008341_1040 size 12
2013-10-31 16:06:11,450 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0003_m_000003_0
2013-10-31 16:06:11,451 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0003_m_000003_0
2013-10-31 16:06:11,452 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4031594352087008341_1040 size 12
2013-10-31 16:06:11,454 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4031594352087008341_1040 size 12
2013-10-31 16:06:11,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=null
2013-10-31 16:06:11,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:11,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:11,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:11,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:11,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:11,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:11,487 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46908, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6755368884408234344_1025, duration: 201403
2013-10-31 16:06:11,500 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:11,500 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000003_0 0.0% 
2013-10-31 16:06:11,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:11,505 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46909, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-281896601574383084_1026, duration: 166462
2013-10-31 16:06:11,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:11,508 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46910, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7989246260074545108_1027, duration: 126465
2013-10-31 16:06:11,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:11,511 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46911, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7841801315324419468_1028, duration: 120448
2013-10-31 16:06:11,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:11,514 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33810, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4456889479922960183_1029, duration: 122312
2013-10-31 16:06:11,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:11,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:11,520 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46913, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 123863
2013-10-31 16:06:11,529 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001. blk_7217921539428146541_1040
2013-10-31 16:06:11,544 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7217921539428146541_1040 src: /127.0.0.1:33881 dest: /127.0.0.1:38271
2013-10-31 16:06:11,545 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7217921539428146541_1040 src: /127.0.0.1:53918 dest: /127.0.0.1:41648
2013-10-31 16:06:11,546 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7217921539428146541_1040 src: /127.0.0.1:33814 dest: /127.0.0.1:50942
2013-10-31 16:06:11,549 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33814, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7217921539428146541_1040, duration: 1263055
2013-10-31 16:06:11,549 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7217921539428146541_1040 terminating
2013-10-31 16:06:11,549 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53918, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7217921539428146541_1040, duration: 1644617
2013-10-31 16:06:11,549 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7217921539428146541_1040 terminating
2013-10-31 16:06:11,549 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33881, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7217921539428146541_1040, duration: 2026638
2013-10-31 16:06:11,549 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7217921539428146541_1040 terminating
2013-10-31 16:06:11,553 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7217921539428146541_1040 size 12
2013-10-31 16:06:11,553 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7217921539428146541_1040 size 12
2013-10-31 16:06:11,553 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7217921539428146541_1040 size 12
2013-10-31 16:06:11,845 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-1716222122 given task: attempt_20131031160444934_0003_m_000002_0
2013-10-31 16:06:11,846 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0003_m_000000_0
2013-10-31 16:06:11,846 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0003_m_000000_0
2013-10-31 16:06:11,892 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:11,893 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000000_0 0.0% 
2013-10-31 16:06:11,900 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_398315277 given task: attempt_20131031160444934_0003_m_000004_0
2013-10-31 16:06:11,952 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0003_m_000001_0
2013-10-31 16:06:11,953 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0003_m_000001_0
2013-10-31 16:06:11,989 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:11,989 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000001_0 0.0% 
2013-10-31 16:06:12,160 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000000_0
2013-10-31 16:06:12,161 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000001_0
2013-10-31 16:06:12,165 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000003_0
2013-10-31 16:06:12,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split	dst=null	perm=null
2013-10-31 16:06:12,355 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46920, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7021115318436035076_1032, duration: 200764
2013-10-31 16:06:12,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:12,395 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33820, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 145699
2013-10-31 16:06:12,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:12,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split	dst=null	perm=null
2013-10-31 16:06:12,453 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33890, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7021115318436035076_1032, duration: 209523
2013-10-31 16:06:12,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0	dst=null	perm=null
2013-10-31 16:06:12,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:12,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:12,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46924, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 353537
2013-10-31 16:06:12,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:12,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:12,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:12,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0	dst=null	perm=null
2013-10-31 16:06:12,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:12,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0	dst=null	perm=null
2013-10-31 16:06:12,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:12,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:12,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=null
2013-10-31 16:06:12,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0	dst=null	perm=null
2013-10-31 16:06:12,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=null
2013-10-31 16:06:12,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:12,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:12,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:12,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:12,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:12,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:12,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:12,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:12,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:12,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:12,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:12,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000	dst=null	perm=null
2013-10-31 16:06:12,926 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33892, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6755368884408234344_1025, duration: 138636
2013-10-31 16:06:12,928 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46926, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6755368884408234344_1025, duration: 124028
2013-10-31 16:06:12,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:12,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001	dst=null	perm=null
2013-10-31 16:06:12,943 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46927, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-281896601574383084_1026, duration: 127597
2013-10-31 16:06:12,945 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33895, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-281896601574383084_1026, duration: 119333
2013-10-31 16:06:12,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:12,946 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33896, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7989246260074545108_1027, duration: 124221
2013-10-31 16:06:12,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002	dst=null	perm=null
2013-10-31 16:06:12,948 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33897, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7989246260074545108_1027, duration: 166460
2013-10-31 16:06:12,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:12,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53934, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7841801315324419468_1028, duration: 177761
2013-10-31 16:06:12,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003	dst=null	perm=null
2013-10-31 16:06:12,951 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53935, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7841801315324419468_1028, duration: 121501
2013-10-31 16:06:12,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:12,953 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53936, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4456889479922960183_1029, duration: 174016
2013-10-31 16:06:12,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004	dst=null	perm=null
2013-10-31 16:06:12,954 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53937, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4456889479922960183_1029, duration: 117324
2013-10-31 16:06:12,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:12,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:12,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:12,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:12,959 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46935, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 172666
2013-10-31 16:06:12,960 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33834, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 123910
2013-10-31 16:06:12,968 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002. blk_8834235696794734646_1042
2013-10-31 16:06:12,969 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004. blk_8499570046378324937_1042
2013-10-31 16:06:12,991 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8834235696794734646_1042 src: /127.0.0.1:46937 dest: /127.0.0.1:47311
2013-10-31 16:06:12,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8499570046378324937_1042 src: /127.0.0.1:46938 dest: /127.0.0.1:47311
2013-10-31 16:06:12,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8834235696794734646_1042 src: /127.0.0.1:33906 dest: /127.0.0.1:38271
2013-10-31 16:06:12,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8499570046378324937_1042 src: /127.0.0.1:33838 dest: /127.0.0.1:50942
2013-10-31 16:06:12,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8834235696794734646_1042 src: /127.0.0.1:53944 dest: /127.0.0.1:41648
2013-10-31 16:06:12,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8499570046378324937_1042 src: /127.0.0.1:33909 dest: /127.0.0.1:38271
2013-10-31 16:06:12,999 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53944, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8834235696794734646_1042, duration: 1041699
2013-10-31 16:06:13,001 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8834235696794734646_1042 terminating
2013-10-31 16:06:13,002 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33906, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8834235696794734646_1042, duration: 5812214
2013-10-31 16:06:13,002 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8834235696794734646_1042 terminating
2013-10-31 16:06:13,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0	dst=null	perm=null
2013-10-31 16:06:13,002 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46937, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8834235696794734646_1042, duration: 6174663
2013-10-31 16:06:13,002 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8834235696794734646_1042 terminating
2013-10-31 16:06:13,003 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33909, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8499570046378324937_1042, duration: 5232021
2013-10-31 16:06:13,009 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8499570046378324937_1042 terminating
2013-10-31 16:06:13,009 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8834235696794734646_1042 size 12
2013-10-31 16:06:13,009 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33838, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8499570046378324937_1042, duration: 13488716
2013-10-31 16:06:13,010 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0003_m_000002_0
2013-10-31 16:06:13,010 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8499570046378324937_1042 terminating
2013-10-31 16:06:13,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:13,011 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0003_m_000002_0
2013-10-31 16:06:13,011 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46938, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8499570046378324937_1042, duration: 11945314
2013-10-31 16:06:13,011 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8834235696794734646_1042 size 12
2013-10-31 16:06:13,011 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8499570046378324937_1042 terminating
2013-10-31 16:06:13,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8834235696794734646_1042 size 12
2013-10-31 16:06:13,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8499570046378324937_1042 size 12
2013-10-31 16:06:13,013 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8499570046378324937_1042 size 12
2013-10-31 16:06:13,013 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8499570046378324937_1042 size 12
2013-10-31 16:06:13,014 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0003_m_000004_0
2013-10-31 16:06:13,014 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0003_m_000004_0
2013-10-31 16:06:13,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:13,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0	dst=null	perm=null
2013-10-31 16:06:13,076 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:13,077 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000002_0 0.0% 
2013-10-31 16:06:13,079 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:13,079 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000004_0 0.0% 
2013-10-31 16:06:13,515 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:06:13,517 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000000_0 is done.
2013-10-31 16:06:13,518 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000000_0  was -1
2013-10-31 16:06:13,518 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:06:13,764 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:06:13,765 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000003_0 is done.
2013-10-31 16:06:13,765 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000003_0  was -1
2013-10-31 16:06:13,766 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:06:14,111 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:06:14,113 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000001_0 is done.
2013-10-31 16:06:14,113 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000001_0  was -1
2013-10-31 16:06:14,113 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:14,158 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0003_m_000006_0
2013-10-31 16:06:14,159 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0003_m_000006_0
2013-10-31 16:06:14,159 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000006_0 not found in cache
2013-10-31 16:06:15,164 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000000_0' has completed task_20131031160444934_0003_m_000000 successfully.
2013-10-31 16:06:15,166 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000001_0' has completed task_20131031160444934_0003_m_000001 successfully.
2013-10-31 16:06:15,169 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000003_0' has completed task_20131031160444934_0003_m_000003 successfully.
2013-10-31 16:06:15,172 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000002_0
2013-10-31 16:06:15,390 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000004_0
2013-10-31 16:06:16,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0	dst=null	perm=null
2013-10-31 16:06:16,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:16,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0	dst=null	perm=null
2013-10-31 16:06:16,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:16,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:16,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:16,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0	dst=null	perm=null
2013-10-31 16:06:16,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0	dst=null	perm=null
2013-10-31 16:06:18,346 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:06:18,348 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:06:18,350 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000002_0 is done.
2013-10-31 16:06:18,351 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000002_0  was -1
2013-10-31 16:06:18,351 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:18,465 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:06:18,466 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:06:18,467 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000004_0 is done.
2013-10-31 16:06:18,467 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000004_0  was -1
2013-10-31 16:06:18,467 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:18,876 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-1293847835140075373_1033
2013-10-31 16:06:21,180 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000002_0' has completed task_20131031160444934_0003_m_000002 successfully.
2013-10-31 16:06:21,399 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000004_0' has completed task_20131031160444934_0003_m_000004 successfully.
2013-10-31 16:06:21,404 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0003_m_000005_0' to tip task_20131031160444934_0003_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:06:21,406 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:06:21,406 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000005_0 which needs 1 slots
2013-10-31 16:06:21,406 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000005_0 which needs 1 slots
2013-10-31 16:06:21,439 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_1233721901
2013-10-31 16:06:21,439 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_1233721901 spawned.
2013-10-31 16:06:21,442 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000005_0/taskjvm.sh
2013-10-31 16:06:22,368 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_1233721901 given task: attempt_20131031160444934_0003_m_000005_0
2013-10-31 16:06:22,872 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000005_0 0.0% 
2013-10-31 16:06:23,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary	dst=null	perm=null
2013-10-31 16:06:23,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:23,583 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS from client DFSClient_attempt_20131031160444934_0003_m_000005_0
2013-10-31 16:06:23,583 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0003_m_000005_0
2013-10-31 16:06:23,589 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-205831684819831428 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:23,589 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-205831684819831428 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:23,589 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-205831684819831428 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:23,589 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-205831684819831428 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:23,590 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7021115318436035076 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:23,590 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7021115318436035076 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:23,590 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7021115318436035076 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:23,590 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7021115318436035076 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:23,590 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1293847835140075373 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:23,591 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1293847835140075373 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:23,591 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1293847835140075373 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:23,591 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1007983707836522264 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:23,591 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1007983707836522264 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:23,591 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1007983707836522264 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:23,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003	dst=null	perm=null
2013-10-31 16:06:24,161 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_1007983707836522264_1034 blk_-205831684819831428_1031 blk_-7021115318436035076_1032 blk_-1293847835140075373_1033
2013-10-31 16:06:24,161 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-205831684819831428_1031 blk_-7021115318436035076_1032
2013-10-31 16:06:24,869 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7021115318436035076_1032 file build/test/data/dfs/data/data6/current/blk_-7021115318436035076 for deletion
2013-10-31 16:06:24,869 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1293847835140075373_1033 file build/test/data/dfs/data/data5/current/blk_-1293847835140075373 for deletion
2013-10-31 16:06:24,870 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7021115318436035076_1032 at file build/test/data/dfs/data/data6/current/blk_-7021115318436035076
2013-10-31 16:06:24,870 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-205831684819831428_1031 file build/test/data/dfs/data/data5/current/blk_-205831684819831428 for deletion
2013-10-31 16:06:24,870 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1293847835140075373_1033 at file build/test/data/dfs/data/data5/current/blk_-1293847835140075373
2013-10-31 16:06:24,870 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1007983707836522264_1034 file build/test/data/dfs/data/data6/current/blk_1007983707836522264 for deletion
2013-10-31 16:06:24,871 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1007983707836522264_1034 at file build/test/data/dfs/data/data6/current/blk_1007983707836522264
2013-10-31 16:06:24,871 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-205831684819831428_1031 at file build/test/data/dfs/data/data5/current/blk_-205831684819831428
2013-10-31 16:06:25,807 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000005_0 0.0% cleanup
2013-10-31 16:06:25,809 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000005_0 is done.
2013-10-31 16:06:25,809 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000005_0  was -1
2013-10-31 16:06:25,809 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:26,859 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7021115318436035076_1032 file build/test/data/dfs/data/data8/current/blk_-7021115318436035076 for deletion
2013-10-31 16:06:26,859 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-205831684819831428_1031 file build/test/data/dfs/data/data7/current/blk_-205831684819831428 for deletion
2013-10-31 16:06:26,860 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7021115318436035076_1032 at file build/test/data/dfs/data/data8/current/blk_-7021115318436035076
2013-10-31 16:06:26,860 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-205831684819831428_1031 at file build/test/data/dfs/data/data7/current/blk_-205831684819831428
2013-10-31 16:06:27,162 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_1007983707836522264_1034 blk_-205831684819831428_1031 blk_-7021115318436035076_1032 blk_-1293847835140075373_1033
2013-10-31 16:06:27,162 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_1007983707836522264_1034 blk_-205831684819831428_1031 blk_-7021115318436035076_1032 blk_-1293847835140075373_1033
2013-10-31 16:06:27,244 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7021115318436035076_1032 file build/test/data/dfs/data/data4/current/blk_-7021115318436035076 for deletion
2013-10-31 16:06:27,244 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1293847835140075373_1033 file build/test/data/dfs/data/data3/current/blk_-1293847835140075373 for deletion
2013-10-31 16:06:27,244 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7021115318436035076_1032 at file build/test/data/dfs/data/data4/current/blk_-7021115318436035076
2013-10-31 16:06:27,245 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1293847835140075373_1033 at file build/test/data/dfs/data/data3/current/blk_-1293847835140075373
2013-10-31 16:06:27,245 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-205831684819831428_1031 file build/test/data/dfs/data/data3/current/blk_-205831684819831428 for deletion
2013-10-31 16:06:27,245 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1007983707836522264_1034 file build/test/data/dfs/data/data4/current/blk_1007983707836522264 for deletion
2013-10-31 16:06:27,245 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-205831684819831428_1031 at file build/test/data/dfs/data/data3/current/blk_-205831684819831428
2013-10-31 16:06:27,246 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1007983707836522264_1034 at file build/test/data/dfs/data/data4/current/blk_1007983707836522264
2013-10-31 16:06:27,414 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000005_0' has completed task_20131031160444934_0003_m_000005 successfully.
2013-10-31 16:06:27,415 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0003 has completed successfully.
2013-10-31 16:06:27,416 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0003,submitTime=1383235561444,launchTime=1383235562435,firstMapTaskLaunchTime=1383235569153,firstJobSetupTaskLaunchTime=1383235563133,firstJobCleanupTaskLaunchTime=1383235581403,finishTime=1383235587415,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=40,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[4D6DBE4C00904663A16DE2E5B8D6F5BD/54A2E4C0D285427AB194FC63FA992B27] upper1*upper2*lower/(1/2) ...rm/joinaroundjoinleftmost
2013-10-31 16:06:27,429 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A. blk_8193787226386140526_1043
2013-10-31 16:06:27,431 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8193787226386140526_1043 src: /127.0.0.1:46946 dest: /127.0.0.1:47311
2013-10-31 16:06:27,434 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8193787226386140526_1043 src: /127.0.0.1:33914 dest: /127.0.0.1:38271
2013-10-31 16:06:27,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8193787226386140526_1043 src: /127.0.0.1:33846 dest: /127.0.0.1:50942
2013-10-31 16:06:27,445 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33846, dest: /127.0.0.1:50942, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8193787226386140526_1043, duration: 5784381
2013-10-31 16:06:27,445 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8193787226386140526_1043 terminating
2013-10-31 16:06:27,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33914, dest: /127.0.0.1:38271, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8193787226386140526_1043, duration: 3875066
2013-10-31 16:06:27,446 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8193787226386140526_1043 terminating
2013-10-31 16:06:27,446 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8193787226386140526_1043 size 26369
2013-10-31 16:06:27,447 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46946, dest: /127.0.0.1:47311, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8193787226386140526_1043, duration: 5587460
2013-10-31 16:06:27,447 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8193787226386140526_1043 terminating
2013-10-31 16:06:27,452 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8193787226386140526_1043 size 26369
2013-10-31 16:06:27,452 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A from client DFSClient_954571228
2013-10-31 16:06:27,453 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A is closed by DFSClient_954571228
2013-10-31 16:06:27,453 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8193787226386140526_1043 size 26369
2013-10-31 16:06:27,461 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:27,462 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000004_0'
2013-10-31 16:06:27,463 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000005_0'
2013-10-31 16:06:27,464 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6141873193401928131 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,464 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6141873193401928131 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,465 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6141873193401928131 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003	dst=null	perm=null
2013-10-31 16:06:27,472 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-685171818103965493 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,472 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0003_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:27,472 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-685171818103965493 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,472 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-685171818103965493 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,473 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6715209515672176699 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,473 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6715209515672176699 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,473 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6715209515672176699 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,473 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6755368884408234344 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,474 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6755368884408234344 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,474 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6755368884408234344 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,474 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-281896601574383084 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,474 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-281896601574383084 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,474 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-281896601574383084 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,475 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7989246260074545108 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,475 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7989246260074545108 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,475 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7989246260074545108 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,475 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7841801315324419468 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,476 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7841801315324419468 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,476 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7841801315324419468 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,476 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4456889479922960183 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,476 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4456889479922960183 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,476 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4456889479922960183 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD	dst=null	perm=null
2013-10-31 16:06:27,484 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary
2013-10-31 16:06:27,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2013-10-31 16:06:27,509 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:06:27,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2013-10-31 16:06:27,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2013-10-31 16:06:27,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2013-10-31 16:06:27,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2013-10-31 16:06:27,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2013-10-31 16:06:27,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2013-10-31 16:06:27,517 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46950, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8753219517823030001_1040, duration: 357287
2013-10-31 16:06:27,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2013-10-31 16:06:27,520 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33918, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7217921539428146541_1040, duration: 152965
2013-10-31 16:06:27,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2013-10-31 16:06:27,522 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53955, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8834235696794734646_1042, duration: 128875
2013-10-31 16:06:27,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2013-10-31 16:06:27,524 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33851, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4031594352087008341_1040, duration: 129526
2013-10-31 16:06:27,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2013-10-31 16:06:27,526 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33921, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8499570046378324937_1042, duration: 125742
2013-10-31 16:06:27,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2013-10-31 16:06:27,539 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:06:27,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2013-10-31 16:06:27,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2013-10-31 16:06:27,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2013-10-31 16:06:27,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2013-10-31 16:06:27,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2013-10-31 16:06:27,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2013-10-31 16:06:27,548 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33922, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8753219517823030001_1040, duration: 208044
2013-10-31 16:06:27,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2013-10-31 16:06:27,551 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33923, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7217921539428146541_1040, duration: 250066
2013-10-31 16:06:27,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2013-10-31 16:06:27,553 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33924, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8834235696794734646_1042, duration: 140647
2013-10-31 16:06:27,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2013-10-31 16:06:27,555 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53961, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4031594352087008341_1040, duration: 133469
2013-10-31 16:06:27,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2013-10-31 16:06:27,557 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33926, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8499570046378324937_1042, duration: 131244
2013-10-31 16:06:27,557 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost
2013-10-31 16:06:27,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2013-10-31 16:06:27,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2013-10-31 16:06:27,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46960, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8753219517823030001_1040, duration: 131011
2013-10-31 16:06:27,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2013-10-31 16:06:27,567 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53964, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7217921539428146541_1040, duration: 134465
2013-10-31 16:06:27,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2013-10-31 16:06:27,571 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33929, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8834235696794734646_1042, duration: 350803
2013-10-31 16:06:27,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2013-10-31 16:06:27,576 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33930, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4031594352087008341_1040, duration: 311680
2013-10-31 16:06:27,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2013-10-31 16:06:27,581 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33862, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8499570046378324937_1042, duration: 334481
2013-10-31 16:06:27,605 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:06:27,606 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:06:27,630 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [tail] starting
2013-10-31 16:06:27,631 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [tail]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:06:27,631 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [tail]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:06:27,631 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [tail]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes"]
2013-10-31 16:06:27,632 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [tail]  parallel execution is enabled: true
2013-10-31 16:06:27,632 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [tail]  starting jobs: 1
2013-10-31 16:06:27,632 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [tail]  allocating threads: 1
2013-10-31 16:06:27,633 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [tail] starting step: (1/1) ...ipesplatform/renamedpipes
2013-10-31 16:06:27,639 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:06:27,639 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:06:27,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:27,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:06:27,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,668 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar. blk_7721447327930509679_1044
2013-10-31 16:06:27,669 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7721447327930509679_1044 src: /127.0.0.1:33863 dest: /127.0.0.1:50942
2013-10-31 16:06:27,671 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7721447327930509679_1044 src: /127.0.0.1:33933 dest: /127.0.0.1:38271
2013-10-31 16:06:27,672 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7721447327930509679_1044 src: /127.0.0.1:46967 dest: /127.0.0.1:47311
2013-10-31 16:06:27,687 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46967, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7721447327930509679_1044, duration: 13039357
2013-10-31 16:06:27,688 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7721447327930509679_1044 terminating
2013-10-31 16:06:27,688 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33933, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7721447327930509679_1044, duration: 10300012
2013-10-31 16:06:27,689 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7721447327930509679_1044 terminating
2013-10-31 16:06:27,689 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33863, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7721447327930509679_1044, duration: 11255949
2013-10-31 16:06:27,689 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7721447327930509679_1044 terminating
2013-10-31 16:06:27,692 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7721447327930509679_1044 size 238055
2013-10-31 16:06:27,693 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar from client DFSClient_1457307213
2013-10-31 16:06:27,693 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar is closed by DFSClient_1457307213
2013-10-31 16:06:27,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7721447327930509679_1044 size 238055
2013-10-31 16:06:27,694 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7721447327930509679_1044 size 238055
2013-10-31 16:06:27,699 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar. New replication is 10
2013-10-31 16:06:27,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar	dst=null	perm=null
2013-10-31 16:06:27,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,714 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:06:27,720 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:06:27,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:27,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,735 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split. New replication is 10
2013-10-31 16:06:27,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split	dst=null	perm=null
2013-10-31 16:06:27,743 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split. blk_4985515153484692347_1045
2013-10-31 16:06:27,745 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4985515153484692347_1045 src: /127.0.0.1:33935 dest: /127.0.0.1:38271
2013-10-31 16:06:27,747 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4985515153484692347_1045 src: /127.0.0.1:46969 dest: /127.0.0.1:47311
2013-10-31 16:06:27,748 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4985515153484692347_1045 src: /127.0.0.1:33868 dest: /127.0.0.1:50942
2013-10-31 16:06:27,750 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4985515153484692347_1045 src: /127.0.0.1:53974 dest: /127.0.0.1:41648
2013-10-31 16:06:27,754 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53974, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4985515153484692347_1045, duration: 2513220
2013-10-31 16:06:27,754 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4985515153484692347_1045 terminating
2013-10-31 16:06:27,755 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33868, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4985515153484692347_1045, duration: 1826571
2013-10-31 16:06:27,755 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4985515153484692347_1045 terminating
2013-10-31 16:06:27,756 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46969, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4985515153484692347_1045, duration: 2786000
2013-10-31 16:06:27,756 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4985515153484692347_1045 terminating
2013-10-31 16:06:27,757 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33935, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4985515153484692347_1045, duration: 3532469
2013-10-31 16:06:27,757 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4985515153484692347_1045 terminating
2013-10-31 16:06:27,760 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4985515153484692347_1045 size 1732
2013-10-31 16:06:27,760 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split from client DFSClient_1457307213
2013-10-31 16:06:27,761 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split is closed by DFSClient_1457307213
2013-10-31 16:06:27,761 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4985515153484692347_1045 size 1732
2013-10-31 16:06:27,761 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4985515153484692347_1045 size 1732
2013-10-31 16:06:27,762 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4985515153484692347_1045 size 1732
2013-10-31 16:06:27,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,780 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo. blk_-2374554834453302461_1046
2013-10-31 16:06:27,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2374554834453302461_1046 src: /127.0.0.1:33939 dest: /127.0.0.1:38271
2013-10-31 16:06:27,784 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2374554834453302461_1046 src: /127.0.0.1:33871 dest: /127.0.0.1:50942
2013-10-31 16:06:27,785 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2374554834453302461_1046 src: /127.0.0.1:46974 dest: /127.0.0.1:47311
2013-10-31 16:06:27,789 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46974, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2374554834453302461_1046, duration: 572470
2013-10-31 16:06:27,789 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2374554834453302461_1046 terminating
2013-10-31 16:06:27,789 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33871, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2374554834453302461_1046, duration: 1409879
2013-10-31 16:06:27,790 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2374554834453302461_1046 terminating
2013-10-31 16:06:27,790 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33939, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2374554834453302461_1046, duration: 2212429
2013-10-31 16:06:27,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2374554834453302461_1046 terminating
2013-10-31 16:06:27,793 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2374554834453302461_1046 size 183
2013-10-31 16:06:27,793 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2374554834453302461_1046 size 183
2013-10-31 16:06:27,794 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2374554834453302461_1046 size 183
2013-10-31 16:06:27,794 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:06:27,795 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:06:27,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,229 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0003
2013-10-31 16:06:28,229 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0003 being deleted.
2013-10-31 16:06:28,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,490 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml. blk_-5693872128215026843_1047
2013-10-31 16:06:28,492 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5693872128215026843_1047 src: /127.0.0.1:46975 dest: /127.0.0.1:47311
2013-10-31 16:06:28,493 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5693872128215026843_1047 src: /127.0.0.1:53979 dest: /127.0.0.1:41648
2013-10-31 16:06:28,495 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5693872128215026843_1047 src: /127.0.0.1:33875 dest: /127.0.0.1:50942
2013-10-31 16:06:28,499 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33875, dest: /127.0.0.1:50942, bytes: 28374, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5693872128215026843_1047, duration: 1040915
2013-10-31 16:06:28,499 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5693872128215026843_1047 terminating
2013-10-31 16:06:28,500 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5693872128215026843_1047 size 28374
2013-10-31 16:06:28,500 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53979, dest: /127.0.0.1:41648, bytes: 28374, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5693872128215026843_1047, duration: 1828025
2013-10-31 16:06:28,500 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5693872128215026843_1047 terminating
2013-10-31 16:06:28,501 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46975, dest: /127.0.0.1:47311, bytes: 28374, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5693872128215026843_1047, duration: 2901378
2013-10-31 16:06:28,501 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5693872128215026843_1047 terminating
2013-10-31 16:06:28,503 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5693872128215026843_1047 size 28374
2013-10-31 16:06:28,503 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml from client DFSClient_1457307213
2013-10-31 16:06:28,504 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml is closed by DFSClient_1457307213
2013-10-31 16:06:28,504 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5693872128215026843_1047 size 28374
2013-10-31 16:06:28,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml	dst=null	perm=null
2013-10-31 16:06:28,520 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33877, bytes: 28598, op: HDFS_READ, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5693872128215026843_1047, duration: 489290
2013-10-31 16:06:28,541 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0004: nMaps=5 nReduces=0 max=-1
2013-10-31 16:06:28,542 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0004 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:06:28,542 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0004	RESULT=SUCCESS
2013-10-31 16:06:28,542 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0004
2013-10-31 16:06:28,543 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0004
2013-10-31 16:06:28,544 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [tail] submitted hadoop job: job_20131031160444934_0004
2013-10-31 16:06:28,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,580 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_conf.xml. blk_-6651499441412400141_1049
2013-10-31 16:06:28,582 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6651499441412400141_1049 src: /127.0.0.1:33878 dest: /127.0.0.1:50942
2013-10-31 16:06:28,584 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6651499441412400141_1049 src: /127.0.0.1:53984 dest: /127.0.0.1:41648
2013-10-31 16:06:28,585 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6651499441412400141_1049 src: /127.0.0.1:33949 dest: /127.0.0.1:38271
2013-10-31 16:06:28,590 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33949, dest: /127.0.0.1:38271, bytes: 28439, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6651499441412400141_1049, duration: 895535
2013-10-31 16:06:28,590 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6651499441412400141_1049 terminating
2013-10-31 16:06:28,591 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6651499441412400141_1049 size 28439
2013-10-31 16:06:28,591 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53984, dest: /127.0.0.1:41648, bytes: 28439, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6651499441412400141_1049, duration: 1841551
2013-10-31 16:06:28,592 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6651499441412400141_1049 terminating
2013-10-31 16:06:28,592 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33878, dest: /127.0.0.1:50942, bytes: 28439, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6651499441412400141_1049, duration: 2907058
2013-10-31 16:06:28,592 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6651499441412400141_1049 terminating
2013-10-31 16:06:28,595 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_conf.xml from client DFSClient_1479709366
2013-10-31 16:06:28,595 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_conf.xml is closed by DFSClient_1479709366
2013-10-31 16:06:28,596 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6651499441412400141_1049 size 28439
2013-10-31 16:06:28,597 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6651499441412400141_1049 size 28439
2013-10-31 16:06:28,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,613 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken. blk_7011938532533120784_1050
2013-10-31 16:06:28,615 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7011938532533120784_1050 src: /127.0.0.1:33881 dest: /127.0.0.1:50942
2013-10-31 16:06:28,617 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7011938532533120784_1050 src: /127.0.0.1:46984 dest: /127.0.0.1:47311
2013-10-31 16:06:28,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7011938532533120784_1050 src: /127.0.0.1:53988 dest: /127.0.0.1:41648
2013-10-31 16:06:28,621 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53988, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7011938532533120784_1050, duration: 273578
2013-10-31 16:06:28,622 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7011938532533120784_1050 terminating
2013-10-31 16:06:28,622 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46984, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7011938532533120784_1050, duration: 1121635
2013-10-31 16:06:28,623 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7011938532533120784_1050 terminating
2013-10-31 16:06:28,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33881, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7011938532533120784_1050, duration: 1986650
2013-10-31 16:06:28,623 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7011938532533120784_1050 size 116
2013-10-31 16:06:28,624 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7011938532533120784_1050 terminating
2013-10-31 16:06:28,627 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7011938532533120784_1050 size 116
2013-10-31 16:06:28,627 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7011938532533120784_1050 size 116
2013-10-31 16:06:28,628 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken from client DFSClient_1457307213
2013-10-31 16:06:28,628 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken is closed by DFSClient_1457307213
2013-10-31 16:06:28,635 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken
2013-10-31 16:06:28,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:06:28,640 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46986, bytes: 187, op: HDFS_READ, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2374554834453302461_1046, duration: 343409
2013-10-31 16:06:28,644 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0004 = 19. Number of splits = 5
2013-10-31 16:06:28,644 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,644 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,645 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,645 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,645 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,645 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,646 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,646 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,646 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,646 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,648 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0004 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:06:28,648 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0004 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:06:29,658 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7021115318436035076_1032 file build/test/data/dfs/data/data1/current/blk_-7021115318436035076 for deletion
2013-10-31 16:06:29,658 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1293847835140075373_1033 file build/test/data/dfs/data/data2/current/blk_-1293847835140075373 for deletion
2013-10-31 16:06:29,659 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7021115318436035076_1032 at file build/test/data/dfs/data/data1/current/blk_-7021115318436035076
2013-10-31 16:06:29,659 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-205831684819831428_1031 file build/test/data/dfs/data/data1/current/blk_-205831684819831428 for deletion
2013-10-31 16:06:29,659 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1293847835140075373_1033 at file build/test/data/dfs/data/data2/current/blk_-1293847835140075373
2013-10-31 16:06:29,659 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1007983707836522264_1034 file build/test/data/dfs/data/data1/current/blk_1007983707836522264 for deletion
2013-10-31 16:06:29,659 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-205831684819831428_1031 at file build/test/data/dfs/data/data1/current/blk_-205831684819831428
2013-10-31 16:06:29,660 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1007983707836522264_1034 at file build/test/data/dfs/data/data1/current/blk_1007983707836522264
2013-10-31 16:06:30,163 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_7721447327930509679_1044 to datanode(s) 127.0.0.1:41648
2013-10-31 16:06:30,163 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_6715209515672176699_1023 blk_7841801315324419468_1028 blk_-685171818103965493_1030 blk_6141873193401928131_1037 blk_-4456889479922960183_1029
2013-10-31 16:06:30,163 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_6715209515672176699_1023 blk_-685171818103965493_1030 blk_-6755368884408234344_1025 blk_-281896601574383084_1026 blk_7989246260074545108_1027
2013-10-31 16:06:30,187 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0004_m_000006_0' to tip task_20131031160444934_0004_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:30,191 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000000_0'
2013-10-31 16:06:30,191 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000001_0'
2013-10-31 16:06:30,192 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000006_0'
2013-10-31 16:06:30,193 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:06:30,194 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000006_0 which needs 1 slots
2013-10-31 16:06:30,194 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000006_0 which needs 1 slots
2013-10-31 16:06:30,195 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000002_0'
2013-10-31 16:06:30,195 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000003_0'
2013-10-31 16:06:30,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken	dst=null	perm=null
2013-10-31 16:06:30,202 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46987, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7011938532533120784_1050, duration: 334508
2013-10-31 16:06:30,202 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadDelay 78 raw values into 2 aggregated values, total 7
2013-10-31 16:06:30,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml	dst=null	perm=null
2013-10-31 16:06:30,213 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53992, bytes: 28598, op: HDFS_READ, cliID: DFSClient_589832289, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5693872128215026843_1047, duration: 474696
2013-10-31 16:06:30,267 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:30,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar	dst=null	perm=null
2013-10-31 16:06:30,289 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46990, bytes: 239915, op: HDFS_READ, cliID: DFSClient_589832289, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7721447327930509679_1044, duration: 1076881
2013-10-31 16:06:30,393 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0003_m_-2067127539
2013-10-31 16:06:30,400 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11239 with signal TERM. Exit code 0
2013-10-31 16:06:30,400 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_-1151283590
2013-10-31 16:06:30,400 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_-1151283590 spawned.
2013-10-31 16:06:30,404 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000006_0/taskjvm.sh
2013-10-31 16:06:30,489 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:30,490 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:30,490 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:30,490 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_-2067127539 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:31,678 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-1151283590 given task: attempt_20131031160444934_0004_m_000006_0
2013-10-31 16:06:32,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:32,465 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0003
2013-10-31 16:06:32,465 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000005_0 not found in cache
2013-10-31 16:06:32,465 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000004_0 not found in cache
2013-10-31 16:06:32,466 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0003 for user-log deletion with retainTimeStamp:1383321992466
2013-10-31 16:06:32,501 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_398315277 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:32,512 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11421 with signal TERM. Exit code 0
2013-10-31 16:06:32,659 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_7721447327930509679_1044 to 127.0.0.1:41648 
2013-10-31 16:06:32,660 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6755368884408234344_1025 file build/test/data/dfs/data/data1/current/blk_-6755368884408234344 for deletion
2013-10-31 16:06:32,660 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-685171818103965493_1030 file build/test/data/dfs/data/data2/current/blk_-685171818103965493 for deletion
2013-10-31 16:06:32,660 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6755368884408234344_1025 at file build/test/data/dfs/data/data1/current/blk_-6755368884408234344
2013-10-31 16:06:32,661 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-685171818103965493_1030 at file build/test/data/dfs/data/data2/current/blk_-685171818103965493
2013-10-31 16:06:32,661 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-281896601574383084_1026 file build/test/data/dfs/data/data2/current/blk_-281896601574383084 for deletion
2013-10-31 16:06:32,661 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7721447327930509679_1044 src: /127.0.0.1:53997 dest: /127.0.0.1:41648
2013-10-31 16:06:32,662 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-281896601574383084_1026 at file build/test/data/dfs/data/data2/current/blk_-281896601574383084
2013-10-31 16:06:32,662 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6715209515672176699_1023 file build/test/data/dfs/data/data2/current/blk_6715209515672176699 for deletion
2013-10-31 16:06:32,662 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_7721447327930509679_1044 to /127.0.0.1:41648
2013-10-31 16:06:32,663 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6715209515672176699_1023 at file build/test/data/dfs/data/data2/current/blk_6715209515672176699
2013-10-31 16:06:32,662 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7989246260074545108_1027 file build/test/data/dfs/data/data1/current/blk_7989246260074545108 for deletion
2013-10-31 16:06:32,664 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7989246260074545108_1027 at file build/test/data/dfs/data/data1/current/blk_7989246260074545108
2013-10-31 16:06:32,666 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_7721447327930509679_1044 src: /127.0.0.1:53997 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:06:32,670 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7721447327930509679_1044 size 238055
2013-10-31 16:06:32,686 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:32,686 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:32,686 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:32,686 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_398315277 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:32,861 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4456889479922960183_1029 file build/test/data/dfs/data/data7/current/blk_-4456889479922960183 for deletion
2013-10-31 16:06:32,861 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-685171818103965493_1030 file build/test/data/dfs/data/data8/current/blk_-685171818103965493 for deletion
2013-10-31 16:06:32,861 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4456889479922960183_1029 at file build/test/data/dfs/data/data7/current/blk_-4456889479922960183
2013-10-31 16:06:32,862 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6141873193401928131_1037 file build/test/data/dfs/data/data8/current/blk_6141873193401928131 for deletion
2013-10-31 16:06:32,862 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-685171818103965493_1030 at file build/test/data/dfs/data/data8/current/blk_-685171818103965493
2013-10-31 16:06:32,862 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6715209515672176699_1023 file build/test/data/dfs/data/data8/current/blk_6715209515672176699 for deletion
2013-10-31 16:06:32,862 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6141873193401928131_1037 at file build/test/data/dfs/data/data8/current/blk_6141873193401928131
2013-10-31 16:06:32,862 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7841801315324419468_1028 file build/test/data/dfs/data/data8/current/blk_7841801315324419468 for deletion
2013-10-31 16:06:32,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6715209515672176699_1023 at file build/test/data/dfs/data/data8/current/blk_6715209515672176699
2013-10-31 16:06:32,863 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7841801315324419468_1028 at file build/test/data/dfs/data/data8/current/blk_7841801315324419468
2013-10-31 16:06:33,164 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_6715209515672176699_1023 blk_7841801315324419468_1028 blk_-685171818103965493_1030 blk_6141873193401928131_1037 blk_-6755368884408234344_1025 blk_-4456889479922960183_1029 blk_-281896601574383084_1026 blk_7989246260074545108_1027
2013-10-31 16:06:33,164 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_7841801315324419468_1028 blk_6141873193401928131_1037 blk_-6755368884408234344_1025 blk_-4456889479922960183_1029 blk_-281896601574383084_1026 blk_7989246260074545108_1027
2013-10-31 16:06:33,259 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6755368884408234344_1025 file build/test/data/dfs/data/data4/current/blk_-6755368884408234344 for deletion
2013-10-31 16:06:33,259 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4456889479922960183_1029 file build/test/data/dfs/data/data4/current/blk_-4456889479922960183 for deletion
2013-10-31 16:06:33,259 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6755368884408234344_1025 at file build/test/data/dfs/data/data4/current/blk_-6755368884408234344
2013-10-31 16:06:33,259 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-281896601574383084_1026 file build/test/data/dfs/data/data3/current/blk_-281896601574383084 for deletion
2013-10-31 16:06:33,260 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4456889479922960183_1029 at file build/test/data/dfs/data/data4/current/blk_-4456889479922960183
2013-10-31 16:06:33,260 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-281896601574383084_1026 at file build/test/data/dfs/data/data3/current/blk_-281896601574383084
2013-10-31 16:06:33,260 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6141873193401928131_1037 file build/test/data/dfs/data/data4/current/blk_6141873193401928131 for deletion
2013-10-31 16:06:33,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7841801315324419468_1028 file build/test/data/dfs/data/data3/current/blk_7841801315324419468 for deletion
2013-10-31 16:06:33,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6141873193401928131_1037 at file build/test/data/dfs/data/data4/current/blk_6141873193401928131
2013-10-31 16:06:33,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7989246260074545108_1027 file build/test/data/dfs/data/data4/current/blk_7989246260074545108 for deletion
2013-10-31 16:06:33,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7841801315324419468_1028 at file build/test/data/dfs/data/data3/current/blk_7841801315324419468
2013-10-31 16:06:33,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7989246260074545108_1027 at file build/test/data/dfs/data/data4/current/blk_7989246260074545108
2013-10-31 16:06:33,872 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6755368884408234344_1025 file build/test/data/dfs/data/data5/current/blk_-6755368884408234344 for deletion
2013-10-31 16:06:33,873 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4456889479922960183_1029 file build/test/data/dfs/data/data5/current/blk_-4456889479922960183 for deletion
2013-10-31 16:06:33,873 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6755368884408234344_1025 at file build/test/data/dfs/data/data5/current/blk_-6755368884408234344
2013-10-31 16:06:33,873 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-685171818103965493_1030 file build/test/data/dfs/data/data6/current/blk_-685171818103965493 for deletion
2013-10-31 16:06:33,873 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4456889479922960183_1029 at file build/test/data/dfs/data/data5/current/blk_-4456889479922960183
2013-10-31 16:06:33,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-281896601574383084_1026 file build/test/data/dfs/data/data6/current/blk_-281896601574383084 for deletion
2013-10-31 16:06:33,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-685171818103965493_1030 at file build/test/data/dfs/data/data6/current/blk_-685171818103965493
2013-10-31 16:06:33,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6141873193401928131_1037 file build/test/data/dfs/data/data5/current/blk_6141873193401928131 for deletion
2013-10-31 16:06:33,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-281896601574383084_1026 at file build/test/data/dfs/data/data6/current/blk_-281896601574383084
2013-10-31 16:06:33,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6715209515672176699_1023 file build/test/data/dfs/data/data5/current/blk_6715209515672176699 for deletion
2013-10-31 16:06:33,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6141873193401928131_1037 at file build/test/data/dfs/data/data5/current/blk_6141873193401928131
2013-10-31 16:06:33,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7841801315324419468_1028 file build/test/data/dfs/data/data6/current/blk_7841801315324419468 for deletion
2013-10-31 16:06:33,875 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_1233721901 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:33,876 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7841801315324419468_1028 at file build/test/data/dfs/data/data6/current/blk_7841801315324419468
2013-10-31 16:06:33,876 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7989246260074545108_1027 file build/test/data/dfs/data/data5/current/blk_7989246260074545108 for deletion
2013-10-31 16:06:33,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6715209515672176699_1023 at file build/test/data/dfs/data/data5/current/blk_6715209515672176699
2013-10-31 16:06:33,878 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7989246260074545108_1027 at file build/test/data/dfs/data/data5/current/blk_7989246260074545108
2013-10-31 16:06:33,887 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11604 with signal TERM. Exit code 0
2013-10-31 16:06:34,070 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:34,070 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:34,070 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:34,070 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_1233721901 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:35,130 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000006_0 0.0% setup
2013-10-31 16:06:35,133 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000006_0 is done.
2013-10-31 16:06:35,133 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000006_0  was -1
2013-10-31 16:06:35,134 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:35,194 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0003
2013-10-31 16:06:35,194 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000000_0 not found in cache
2013-10-31 16:06:35,195 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000001_0 not found in cache
2013-10-31 16:06:35,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0003 for user-log deletion with retainTimeStamp:1383321995195
2013-10-31 16:06:35,196 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0003
2013-10-31 16:06:35,196 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000002_0 not found in cache
2013-10-31 16:06:35,196 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000003_0 not found in cache
2013-10-31 16:06:35,197 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0003 for user-log deletion with retainTimeStamp:1383321995197
2013-10-31 16:06:35,328 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_-1219933498 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:35,338 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11308 with signal TERM. Exit code 0
2013-10-31 16:06:35,390 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_-1716222122 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:35,399 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11380 with signal TERM. Exit code 0
2013-10-31 16:06:35,527 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:35,527 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:35,528 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:35,528 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_-1219933498 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:35,542 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:35,542 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:35,543 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:35,543 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_-1716222122 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:35,669 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_-978688131 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:35,679 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11091 with signal TERM. Exit code 0
2013-10-31 16:06:35,928 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:35,928 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:35,929 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:35,929 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_-978688131 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:06:36,199 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000006_0' has completed task_20131031160444934_0004_m_000006 successfully.
2013-10-31 16:06:36,203 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000000_0' to tip task_20131031160444934_0004_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:36,204 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000000
2013-10-31 16:06:36,205 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000001_0' to tip task_20131031160444934_0004_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:36,205 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000001
2013-10-31 16:06:36,207 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000002_0' to tip task_20131031160444934_0004_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:36,209 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:06:36,209 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000002
2013-10-31 16:06:36,210 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:06:36,210 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000003_0' to tip task_20131031160444934_0004_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:36,210 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000000_0 which needs 1 slots
2013-10-31 16:06:36,210 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000003
2013-10-31 16:06:36,211 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000000_0 which needs 1 slots
2013-10-31 16:06:36,211 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000001_0 which needs 1 slots
2013-10-31 16:06:36,211 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0004_m_000001_0 which needs 1 slots
2013-10-31 16:06:36,213 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:06:36,214 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:06:36,215 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000002_0 which needs 1 slots
2013-10-31 16:06:36,217 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000002_0 which needs 1 slots
2013-10-31 16:06:36,217 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000003_0 which needs 1 slots
2013-10-31 16:06:36,218 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0004_m_000003_0 which needs 1 slots
2013-10-31 16:06:36,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken	dst=null	perm=null
2013-10-31 16:06:36,228 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54001, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7011938532533120784_1050, duration: 347479
2013-10-31 16:06:36,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml	dst=null	perm=null
2013-10-31 16:06:36,242 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47000, bytes: 28598, op: HDFS_READ, cliID: DFSClient_-1135888677, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5693872128215026843_1047, duration: 487751
2013-10-31 16:06:36,256 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_-389116012
2013-10-31 16:06:36,256 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_-389116012 spawned.
2013-10-31 16:06:36,257 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0004/attempt_20131031160444934_0004_m_000001_0. Attempting to reuse: jvm_20131031160444934_0004_m_-1151283590
2013-10-31 16:06:36,259 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000000_0/taskjvm.sh
2013-10-31 16:06:36,278 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:36,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar	dst=null	perm=null
2013-10-31 16:06:36,319 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33899, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1135888677, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7721447327930509679_1044, duration: 2125627
2013-10-31 16:06:36,418 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_-2130177320
2013-10-31 16:06:36,420 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_-2130177320 spawned.
2013-10-31 16:06:36,420 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_-1475551417
2013-10-31 16:06:36,420 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_-1475551417 spawned.
2013-10-31 16:06:36,423 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000002_0/taskjvm.sh
2013-10-31 16:06:36,423 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000003_0/taskjvm.sh
2013-10-31 16:06:36,473 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000004_0' to tip task_20131031160444934_0004_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:06:36,474 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000004
2013-10-31 16:06:36,475 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:06:36,475 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000004_0 which needs 1 slots
2013-10-31 16:06:36,476 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000004_0 which needs 1 slots
2013-10-31 16:06:36,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken	dst=null	perm=null
2013-10-31 16:06:36,484 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54005, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7011938532533120784_1050, duration: 158719
2013-10-31 16:06:36,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml	dst=null	perm=null
2013-10-31 16:06:36,494 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33902, bytes: 28598, op: HDFS_READ, cliID: DFSClient_1208501720, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5693872128215026843_1047, duration: 209943
2013-10-31 16:06:36,523 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:36,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar	dst=null	perm=null
2013-10-31 16:06:36,561 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47005, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1208501720, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7721447327930509679_1044, duration: 2009608
2013-10-31 16:06:36,671 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_2107520939
2013-10-31 16:06:36,671 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_2107520939 spawned.
2013-10-31 16:06:36,673 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000004_0/taskjvm.sh
2013-10-31 16:06:36,699 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-1151283590 given task: attempt_20131031160444934_0004_m_000001_0
2013-10-31 16:06:36,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split	dst=null	perm=null
2013-10-31 16:06:36,820 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33974, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4985515153484692347_1045, duration: 197739
2013-10-31 16:06:36,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:36,862 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47008, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 305856
2013-10-31 16:06:36,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:36,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:37,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:37,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:37,121 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47009, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 134891
2013-10-31 16:06:37,129 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001. blk_1449395719476858224_1051
2013-10-31 16:06:37,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1449395719476858224_1051 src: /127.0.0.1:54013 dest: /127.0.0.1:41648
2013-10-31 16:06:37,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1449395719476858224_1051 src: /127.0.0.1:33978 dest: /127.0.0.1:38271
2013-10-31 16:06:37,158 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1449395719476858224_1051 src: /127.0.0.1:33910 dest: /127.0.0.1:50942
2013-10-31 16:06:37,161 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33910, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1449395719476858224_1051, duration: 1618659
2013-10-31 16:06:37,162 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1449395719476858224_1051 terminating
2013-10-31 16:06:37,162 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33978, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1449395719476858224_1051, duration: 2030816
2013-10-31 16:06:37,163 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1449395719476858224_1051 terminating
2013-10-31 16:06:37,163 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54013, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1449395719476858224_1051, duration: 2975967
2013-10-31 16:06:37,163 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1449395719476858224_1051 terminating
2013-10-31 16:06:37,163 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1449395719476858224_1051 size 8
2013-10-31 16:06:37,164 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1449395719476858224_1051 size 8
2013-10-31 16:06:37,166 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1449395719476858224_1051 size 8
2013-10-31 16:06:37,167 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0004_m_000001_0
2013-10-31 16:06:37,167 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0004_m_000001_0
2013-10-31 16:06:37,216 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:37,216 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000001_0 0.0% 
2013-10-31 16:06:38,239 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-389116012 given task: attempt_20131031160444934_0004_m_000000_0
2013-10-31 16:06:38,259 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3600945390313710710_1002
2013-10-31 16:06:38,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split	dst=null	perm=null
2013-10-31 16:06:38,735 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33985, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4985515153484692347_1045, duration: 259960
2013-10-31 16:06:38,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:38,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:38,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:38,797 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-1475551417 given task: attempt_20131031160444934_0004_m_000003_0
2013-10-31 16:06:38,800 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_2107520939 given task: attempt_20131031160444934_0004_m_000004_0
2013-10-31 16:06:38,807 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-2130177320 given task: attempt_20131031160444934_0004_m_000002_0
2013-10-31 16:06:39,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:39,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:39,006 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47019, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 172782
2013-10-31 16:06:39,010 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33918, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 136852
2013-10-31 16:06:39,018 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000. blk_-7357275626124955184_1052
2013-10-31 16:06:39,042 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7357275626124955184_1052 src: /127.0.0.1:33988 dest: /127.0.0.1:38271
2013-10-31 16:06:39,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7357275626124955184_1052 src: /127.0.0.1:54025 dest: /127.0.0.1:41648
2013-10-31 16:06:39,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7357275626124955184_1052 src: /127.0.0.1:47023 dest: /127.0.0.1:47311
2013-10-31 16:06:39,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47023, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7357275626124955184_1052, duration: 1670712
2013-10-31 16:06:39,047 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7357275626124955184_1052 terminating
2013-10-31 16:06:39,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54025, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7357275626124955184_1052, duration: 1904524
2013-10-31 16:06:39,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7357275626124955184_1052 terminating
2013-10-31 16:06:39,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33988, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7357275626124955184_1052, duration: 2367853
2013-10-31 16:06:39,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7357275626124955184_1052 terminating
2013-10-31 16:06:39,048 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7357275626124955184_1052 size 8
2013-10-31 16:06:39,049 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0004_m_000000_0
2013-10-31 16:06:39,049 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0004_m_000000_0
2013-10-31 16:06:39,049 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7357275626124955184_1052 size 8
2013-10-31 16:06:39,050 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7357275626124955184_1052 size 8
2013-10-31 16:06:39,213 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000001_0
2013-10-31 16:06:39,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0	dst=null	perm=null
2013-10-31 16:06:39,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:39,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:39,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0	dst=null	perm=null
2013-10-31 16:06:39,330 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:39,330 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000000_0 0.0% 
2013-10-31 16:06:39,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split	dst=null	perm=null
2013-10-31 16:06:39,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split	dst=null	perm=null
2013-10-31 16:06:39,428 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33924, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4985515153484692347_1045, duration: 196590
2013-10-31 16:06:39,429 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54030, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4985515153484692347_1045, duration: 179595
2013-10-31 16:06:39,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:39,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:39,467 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47029, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 135739
2013-10-31 16:06:39,468 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33997, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 129766
2013-10-31 16:06:39,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:39,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:39,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:39,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:39,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split	dst=null	perm=null
2013-10-31 16:06:39,515 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33998, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4985515153484692347_1045, duration: 207379
2013-10-31 16:06:39,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:39,555 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47032, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 146989
2013-10-31 16:06:39,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:39,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:39,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:39,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:39,696 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33931, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 148377
2013-10-31 16:06:39,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:39,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:39,706 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003. blk_-3591799862562816615_1055
2013-10-31 16:06:39,708 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33933, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 123828
2013-10-31 16:06:39,717 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004. blk_-8669963822589499838_1055
2013-10-31 16:06:39,728 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3591799862562816615_1055 src: /127.0.0.1:54037 dest: /127.0.0.1:41648
2013-10-31 16:06:39,729 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3591799862562816615_1055 src: /127.0.0.1:34004 dest: /127.0.0.1:38271
2013-10-31 16:06:39,730 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3591799862562816615_1055 src: /127.0.0.1:33936 dest: /127.0.0.1:50942
2013-10-31 16:06:39,733 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33936, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3591799862562816615_1055, duration: 1446199
2013-10-31 16:06:39,734 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3591799862562816615_1055 terminating
2013-10-31 16:06:39,734 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34004, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3591799862562816615_1055, duration: 2600645
2013-10-31 16:06:39,734 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3591799862562816615_1055 terminating
2013-10-31 16:06:39,734 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54037, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3591799862562816615_1055, duration: 3001074
2013-10-31 16:06:39,735 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3591799862562816615_1055 terminating
2013-10-31 16:06:39,736 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3591799862562816615_1055 size 8
2013-10-31 16:06:39,737 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3591799862562816615_1055 size 8
2013-10-31 16:06:39,737 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3591799862562816615_1055 size 8
2013-10-31 16:06:39,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8669963822589499838_1055 src: /127.0.0.1:54039 dest: /127.0.0.1:41648
2013-10-31 16:06:39,742 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8669963822589499838_1055 src: /127.0.0.1:33937 dest: /127.0.0.1:50942
2013-10-31 16:06:39,742 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8669963822589499838_1055 src: /127.0.0.1:34007 dest: /127.0.0.1:38271
2013-10-31 16:06:39,744 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34007, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8669963822589499838_1055, duration: 1098631
2013-10-31 16:06:39,744 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8669963822589499838_1055 terminating
2013-10-31 16:06:39,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33937, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8669963822589499838_1055, duration: 1689512
2013-10-31 16:06:39,745 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8669963822589499838_1055 terminating
2013-10-31 16:06:39,745 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8669963822589499838_1055 size 8
2013-10-31 16:06:39,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54039, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8669963822589499838_1055, duration: 2012976
2013-10-31 16:06:39,745 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8669963822589499838_1055 size 8
2013-10-31 16:06:39,745 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8669963822589499838_1055 terminating
2013-10-31 16:06:39,746 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0004_m_000004_0
2013-10-31 16:06:39,746 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0004_m_000004_0
2013-10-31 16:06:39,748 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8669963822589499838_1055 size 8
2013-10-31 16:06:39,780 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:06:39,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:39,780 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000001_0 is done.
2013-10-31 16:06:39,781 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000001_0  was -1
2013-10-31 16:06:39,781 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:06:39,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:39,786 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33939, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 141331
2013-10-31 16:06:39,792 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:39,793 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000004_0 0.0% 
2013-10-31 16:06:39,796 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002. blk_-3081719028497960391_1055
2013-10-31 16:06:39,819 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3081719028497960391_1055 src: /127.0.0.1:47042 dest: /127.0.0.1:47311
2013-10-31 16:06:39,821 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3081719028497960391_1055 src: /127.0.0.1:33941 dest: /127.0.0.1:50942
2013-10-31 16:06:39,822 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3081719028497960391_1055 src: /127.0.0.1:54047 dest: /127.0.0.1:41648
2013-10-31 16:06:39,825 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54047, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3081719028497960391_1055, duration: 1536233
2013-10-31 16:06:39,825 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3081719028497960391_1055 terminating
2013-10-31 16:06:39,826 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33941, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3081719028497960391_1055, duration: 1721653
2013-10-31 16:06:39,826 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3081719028497960391_1055 terminating
2013-10-31 16:06:39,826 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47042, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3081719028497960391_1055, duration: 2675142
2013-10-31 16:06:39,827 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3081719028497960391_1055 terminating
2013-10-31 16:06:39,828 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3081719028497960391_1055 size 8
2013-10-31 16:06:39,829 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0004_m_000002_0
2013-10-31 16:06:39,829 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0004_m_000002_0
2013-10-31 16:06:39,829 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3081719028497960391_1055 size 8
2013-10-31 16:06:39,830 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3081719028497960391_1055 size 8
2013-10-31 16:06:39,849 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:06:39,856 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,867 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,873 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,879 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:39,879 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000002_0 0.0% 
2013-10-31 16:06:39,880 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,885 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,886 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 16:06:40,137 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0004_m_000003_0
2013-10-31 16:06:40,138 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0004_m_000003_0
2013-10-31 16:06:40,192 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:40,193 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000003_0 0.0% 
2013-10-31 16:06:41,210 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0004_m_000006_0
2013-10-31 16:06:41,211 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0004_m_000006_0
2013-10-31 16:06:41,211 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000006_0 not found in cache
2013-10-31 16:06:42,217 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000001_0' has completed task_20131031160444934_0004_m_000001 successfully.
2013-10-31 16:06:42,219 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000000_0
2013-10-31 16:06:42,220 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000002_0
2013-10-31 16:06:42,221 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000003_0
2013-10-31 16:06:42,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0	dst=null	perm=null
2013-10-31 16:06:42,349 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 300 Total time for transactions(ms): 8Number of transactions batched in Syncs: 32 Number of syncs: 206 SyncTimes(ms): 9432 882 
2013-10-31 16:06:42,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:42,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:42,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0	dst=null	perm=null
2013-10-31 16:06:42,481 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000004_0
2013-10-31 16:06:42,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0	dst=null	perm=null
2013-10-31 16:06:42,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:42,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:42,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0	dst=null	perm=null
2013-10-31 16:06:42,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0	dst=null	perm=null
2013-10-31 16:06:42,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:43,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:43,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0	dst=null	perm=null
2013-10-31 16:06:43,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0	dst=null	perm=null
2013-10-31 16:06:43,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:43,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:43,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0	dst=null	perm=null
2013-10-31 16:06:44,710 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:06:44,712 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:06:44,713 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000000_0 is done.
2013-10-31 16:06:44,713 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000000_0  was -1
2013-10-31 16:06:44,713 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:45,223 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000000_0' has completed task_20131031160444934_0004_m_000000 successfully.
2013-10-31 16:06:45,393 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:06:45,395 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:06:45,395 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000003_0 is done.
2013-10-31 16:06:45,396 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000003_0  was -1
2013-10-31 16:06:45,396 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:06:45,408 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:06:45,410 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:06:45,411 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000004_0 is done.
2013-10-31 16:06:45,411 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000004_0  was -1
2013-10-31 16:06:45,411 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:45,478 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:06:45,482 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:06:45,483 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000002_0 is done.
2013-10-31 16:06:45,484 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000002_0  was -1
2013-10-31 16:06:45,484 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:45,485 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000004_0' has completed task_20131031160444934_0004_m_000004 successfully.
2013-10-31 16:06:48,230 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000002_0' has completed task_20131031160444934_0004_m_000002 successfully.
2013-10-31 16:06:48,255 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000003_0' has completed task_20131031160444934_0004_m_000003 successfully.
2013-10-31 16:06:48,260 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0004_m_000005_0' to tip task_20131031160444934_0004_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:48,262 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:06:48,262 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000005_0 which needs 1 slots
2013-10-31 16:06:48,263 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000005_0 which needs 1 slots
2013-10-31 16:06:48,298 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0004/attempt_20131031160444934_0004_m_000005_0. Attempting to reuse: jvm_20131031160444934_0004_m_-1475551417
2013-10-31 16:06:48,945 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-1475551417 given task: attempt_20131031160444934_0004_m_000005_0
2013-10-31 16:06:49,038 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000005_0 0.0% 
2013-10-31 16:06:49,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary	dst=null	perm=null
2013-10-31 16:06:49,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:49,055 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_SUCCESS from client DFSClient_attempt_20131031160444934_0004_m_000005_0
2013-10-31 16:06:49,055 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0004_m_000005_0
2013-10-31 16:06:49,061 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7721447327930509679 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:49,061 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7721447327930509679 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:49,062 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7721447327930509679 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:49,062 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7721447327930509679 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:49,062 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4985515153484692347 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:49,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4985515153484692347 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:49,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4985515153484692347 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:49,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4985515153484692347 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2374554834453302461 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2374554834453302461 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2374554834453302461 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:49,065 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5693872128215026843 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:49,065 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5693872128215026843 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:49,066 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5693872128215026843 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:49,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004	dst=null	perm=null
2013-10-31 16:06:51,167 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-2374554834453302461_1046 blk_-5693872128215026843_1047 blk_7721447327930509679_1044 blk_4985515153484692347_1045
2013-10-31 16:06:51,168 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-2374554834453302461_1046 blk_-5693872128215026843_1047 blk_7721447327930509679_1044 blk_4985515153484692347_1045
2013-10-31 16:06:51,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5693872128215026843_1047 file build/test/data/dfs/data/data4/current/blk_-5693872128215026843 for deletion
2013-10-31 16:06:51,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2374554834453302461_1046 file build/test/data/dfs/data/data3/current/blk_-2374554834453302461 for deletion
2013-10-31 16:06:51,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5693872128215026843_1047 at file build/test/data/dfs/data/data4/current/blk_-5693872128215026843
2013-10-31 16:06:51,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4985515153484692347_1045 file build/test/data/dfs/data/data4/current/blk_4985515153484692347 for deletion
2013-10-31 16:06:51,267 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2374554834453302461_1046 at file build/test/data/dfs/data/data3/current/blk_-2374554834453302461
2013-10-31 16:06:51,267 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7721447327930509679_1044 file build/test/data/dfs/data/data3/current/blk_7721447327930509679 for deletion
2013-10-31 16:06:51,267 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4985515153484692347_1045 at file build/test/data/dfs/data/data4/current/blk_4985515153484692347
2013-10-31 16:06:51,268 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7721447327930509679_1044 at file build/test/data/dfs/data/data3/current/blk_7721447327930509679
2013-10-31 16:06:52,012 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000005_0 0.0% cleanup
2013-10-31 16:06:52,013 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000005_0 is done.
2013-10-31 16:06:52,014 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000005_0  was -1
2013-10-31 16:06:52,014 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:53,868 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5693872128215026843_1047 file build/test/data/dfs/data/data8/current/blk_-5693872128215026843 for deletion
2013-10-31 16:06:53,868 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2374554834453302461_1046 file build/test/data/dfs/data/data7/current/blk_-2374554834453302461 for deletion
2013-10-31 16:06:53,868 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5693872128215026843_1047 at file build/test/data/dfs/data/data8/current/blk_-5693872128215026843
2013-10-31 16:06:53,869 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4985515153484692347_1045 file build/test/data/dfs/data/data8/current/blk_4985515153484692347 for deletion
2013-10-31 16:06:53,869 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2374554834453302461_1046 at file build/test/data/dfs/data/data7/current/blk_-2374554834453302461
2013-10-31 16:06:53,869 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4985515153484692347_1045 at file build/test/data/dfs/data/data8/current/blk_4985515153484692347
2013-10-31 16:06:53,869 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7721447327930509679_1044 file build/test/data/dfs/data/data7/current/blk_7721447327930509679 for deletion
2013-10-31 16:06:53,870 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7721447327930509679_1044 at file build/test/data/dfs/data/data7/current/blk_7721447327930509679
2013-10-31 16:06:54,168 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-5693872128215026843_1047 blk_7721447327930509679_1044 blk_4985515153484692347_1045
2013-10-31 16:06:54,168 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-2374554834453302461_1046 blk_7721447327930509679_1044 blk_4985515153484692347_1045
2013-10-31 16:06:54,271 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000005_0' has completed task_20131031160444934_0004_m_000005 successfully.
2013-10-31 16:06:54,272 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0004 has completed successfully.
2013-10-31 16:06:54,272 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0004,submitTime=1383235588508,launchTime=1383235588648,firstMapTaskLaunchTime=1383235596203,firstJobSetupTaskLaunchTime=1383235590186,firstJobCleanupTaskLaunchTime=1383235608259,finishTime=1383235614272,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[C301A18D6809482D9C99B3DF7ED74D6F/01A575840C0E48F08DD429208D422466] tail/(1/1) ...ipesplatform/renamedpipes
2013-10-31 16:06:54,279 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0. blk_3549128818189452633_1056
2013-10-31 16:06:54,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3549128818189452633_1056 src: /127.0.0.1:54050 dest: /127.0.0.1:41648
2013-10-31 16:06:54,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3549128818189452633_1056 src: /127.0.0.1:33946 dest: /127.0.0.1:50942
2013-10-31 16:06:54,285 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3549128818189452633_1056 src: /127.0.0.1:34016 dest: /127.0.0.1:38271
2013-10-31 16:06:54,296 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34016, dest: /127.0.0.1:38271, bytes: 26330, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3549128818189452633_1056, duration: 6512926
2013-10-31 16:06:54,296 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3549128818189452633_1056 terminating
2013-10-31 16:06:54,297 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33946, dest: /127.0.0.1:50942, bytes: 26330, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3549128818189452633_1056, duration: 8869846
2013-10-31 16:06:54,297 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3549128818189452633_1056 terminating
2013-10-31 16:06:54,298 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54050, dest: /127.0.0.1:41648, bytes: 26330, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3549128818189452633_1056, duration: 6808679
2013-10-31 16:06:54,299 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3549128818189452633_1056 size 26330
2013-10-31 16:06:54,299 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3549128818189452633_1056 terminating
2013-10-31 16:06:54,303 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3549128818189452633_1056 size 26330
2013-10-31 16:06:54,307 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0 from client DFSClient_1479709366
2013-10-31 16:06:54,308 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0 is closed by DFSClient_1479709366
2013-10-31 16:06:54,308 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3549128818189452633_1056 size 26330
2013-10-31 16:06:54,314 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:54,316 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000002_0'
2013-10-31 16:06:54,316 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000003_0'
2013-10-31 16:06:54,316 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000005_0'
2013-10-31 16:06:54,318 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7011938532533120784 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:54,318 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7011938532533120784 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:54,318 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7011938532533120784 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:54,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004	dst=null	perm=null
2013-10-31 16:06:54,323 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0004_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:54,326 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary
2013-10-31 16:06:54,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2013-10-31 16:06:54,350 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:06:54,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2013-10-31 16:06:54,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2013-10-31 16:06:54,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2013-10-31 16:06:54,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2013-10-31 16:06:54,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2013-10-31 16:06:54,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2013-10-31 16:06:54,355 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54054, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7357275626124955184_1052, duration: 143043
2013-10-31 16:06:54,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2013-10-31 16:06:54,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54055, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1449395719476858224_1051, duration: 152519
2013-10-31 16:06:54,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2013-10-31 16:06:54,358 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33951, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3081719028497960391_1055, duration: 133063
2013-10-31 16:06:54,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2013-10-31 16:06:54,359 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54057, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3591799862562816615_1055, duration: 132880
2013-10-31 16:06:54,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2013-10-31 16:06:54,360 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54058, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8669963822589499838_1055, duration: 131564
2013-10-31 16:06:54,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2013-10-31 16:06:54,369 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:06:54,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2013-10-31 16:06:54,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2013-10-31 16:06:54,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2013-10-31 16:06:54,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2013-10-31 16:06:54,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2013-10-31 16:06:54,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2013-10-31 16:06:54,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54059, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7357275626124955184_1052, duration: 129060
2013-10-31 16:06:54,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2013-10-31 16:06:54,375 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54060, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1449395719476858224_1051, duration: 124967
2013-10-31 16:06:54,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2013-10-31 16:06:54,376 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54061, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3081719028497960391_1055, duration: 123299
2013-10-31 16:06:54,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2013-10-31 16:06:54,378 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34026, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3591799862562816615_1055, duration: 122990
2013-10-31 16:06:54,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2013-10-31 16:06:54,379 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34027, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8669963822589499838_1055, duration: 126178
2013-10-31 16:06:54,379 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/renamedpipes
2013-10-31 16:06:54,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2013-10-31 16:06:54,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2013-10-31 16:06:54,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54064, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7357275626124955184_1052, duration: 139970
2013-10-31 16:06:54,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2013-10-31 16:06:54,385 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54065, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1449395719476858224_1051, duration: 128887
2013-10-31 16:06:54,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2013-10-31 16:06:54,387 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47063, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3081719028497960391_1055, duration: 150829
2013-10-31 16:06:54,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2013-10-31 16:06:54,389 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34031, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3591799862562816615_1055, duration: 121875
2013-10-31 16:06:54,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2013-10-31 16:06:54,393 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33963, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8669963822589499838_1055, duration: 224181
2013-10-31 16:06:54,412 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:06:54,412 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:06:54,449 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:06:54,449 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:06:54,449 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:06:54,450 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery"]
2013-10-31 16:06:54,451 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:06:54,451 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 3
2013-10-31 16:06:54,451 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 3
2013-10-31 16:06:54,453 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/3)
2013-10-31 16:06:54,454 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/3)
2013-10-31 16:06:54,460 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:06:54,460 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:06:54,463 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:06:54,463 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:06:54,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:54,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:06:54,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:54,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:06:54,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:54,494 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar. blk_-8532132085552426957_1057
2013-10-31 16:06:54,496 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000004_0'
2013-10-31 16:06:54,497 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8532132085552426957_1057 src: /127.0.0.1:54069 dest: /127.0.0.1:41648
2013-10-31 16:06:54,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8532132085552426957_1057 src: /127.0.0.1:34034 dest: /127.0.0.1:38271
2013-10-31 16:06:54,500 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8532132085552426957_1057 src: /127.0.0.1:47068 dest: /127.0.0.1:47311
2013-10-31 16:06:54,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:54,505 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar. blk_6795492832038410935_1058
2013-10-31 16:06:54,507 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6795492832038410935_1058 src: /127.0.0.1:54072 dest: /127.0.0.1:41648
2013-10-31 16:06:54,509 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47068, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8532132085552426957_1057, duration: 4475447
2013-10-31 16:06:54,509 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6795492832038410935_1058 src: /127.0.0.1:33968 dest: /127.0.0.1:50942
2013-10-31 16:06:54,509 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8532132085552426957_1057 terminating
2013-10-31 16:06:54,510 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8532132085552426957_1057 size 238055
2013-10-31 16:06:54,510 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34034, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8532132085552426957_1057, duration: 5345547
2013-10-31 16:06:54,511 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8532132085552426957_1057 terminating
2013-10-31 16:06:54,511 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54069, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8532132085552426957_1057, duration: 6609377
2013-10-31 16:06:54,511 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6795492832038410935_1058 src: /127.0.0.1:47071 dest: /127.0.0.1:47311
2013-10-31 16:06:54,512 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8532132085552426957_1057 terminating
2013-10-31 16:06:54,513 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8532132085552426957_1057 size 238055
2013-10-31 16:06:54,514 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar from client DFSClient_1457307213
2013-10-31 16:06:54,517 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar is closed by DFSClient_1457307213
2013-10-31 16:06:54,517 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8532132085552426957_1057 size 238055
2013-10-31 16:06:54,526 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar. New replication is 10
2013-10-31 16:06:54,528 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47071, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6795492832038410935_1058, duration: 10533753
2013-10-31 16:06:54,528 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6795492832038410935_1058 terminating
2013-10-31 16:06:54,529 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33968, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6795492832038410935_1058, duration: 11694864
2013-10-31 16:06:54,529 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6795492832038410935_1058 terminating
2013-10-31 16:06:54,529 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54072, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6795492832038410935_1058, duration: 12246990
2013-10-31 16:06:54,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar	dst=null	perm=null
2013-10-31 16:06:54,530 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6795492832038410935_1058 terminating
2013-10-31 16:06:54,533 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6795492832038410935_1058 size 238055
2013-10-31 16:06:54,533 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar from client DFSClient_1457307213
2013-10-31 16:06:54,534 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar is closed by DFSClient_1457307213
2013-10-31 16:06:54,534 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6795492832038410935_1058 size 238055
2013-10-31 16:06:54,534 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6795492832038410935_1058 size 238055
2013-10-31 16:06:54,579 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar. New replication is 10
2013-10-31 16:06:54,879 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5693872128215026843_1047 file build/test/data/dfs/data/data5/current/blk_-5693872128215026843 for deletion
2013-10-31 16:06:54,879 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4985515153484692347_1045 file build/test/data/dfs/data/data6/current/blk_4985515153484692347 for deletion
2013-10-31 16:06:54,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5693872128215026843_1047 at file build/test/data/dfs/data/data5/current/blk_-5693872128215026843
2013-10-31 16:06:54,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7721447327930509679_1044 file build/test/data/dfs/data/data6/current/blk_7721447327930509679 for deletion
2013-10-31 16:06:54,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4985515153484692347_1045 at file build/test/data/dfs/data/data6/current/blk_4985515153484692347
2013-10-31 16:06:54,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7721447327930509679_1044 at file build/test/data/dfs/data/data6/current/blk_7721447327930509679
2013-10-31 16:06:55,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,176 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:06:55,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar	dst=null	perm=null
2013-10-31 16:06:55,183 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:06:55,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:06:55,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,188 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:06:55,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,194 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:06:55,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:06:55,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,200 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split. New replication is 10
2013-10-31 16:06:55,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split	dst=null	perm=null
2013-10-31 16:06:55,212 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split. blk_-6361285198433998341_1060
2013-10-31 16:06:55,213 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6361285198433998341_1060 src: /127.0.0.1:47073 dest: /127.0.0.1:47311
2013-10-31 16:06:55,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6361285198433998341_1060 src: /127.0.0.1:33972 dest: /127.0.0.1:50942
2013-10-31 16:06:55,217 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6361285198433998341_1060 src: /127.0.0.1:34042 dest: /127.0.0.1:38271
2013-10-31 16:06:55,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6361285198433998341_1060 src: /127.0.0.1:54079 dest: /127.0.0.1:41648
2013-10-31 16:06:55,222 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54079, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6361285198433998341_1060, duration: 92486
2013-10-31 16:06:55,223 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6361285198433998341_1060 terminating
2013-10-31 16:06:55,223 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34042, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6361285198433998341_1060, duration: 945435
2013-10-31 16:06:55,224 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6361285198433998341_1060 terminating
2013-10-31 16:06:55,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33972, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6361285198433998341_1060, duration: 1862523
2013-10-31 16:06:55,224 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6361285198433998341_1060 size 1732
2013-10-31 16:06:55,224 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6361285198433998341_1060 terminating
2013-10-31 16:06:55,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47073, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6361285198433998341_1060, duration: 2741700
2013-10-31 16:06:55,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-6361285198433998341_1060 terminating
2013-10-31 16:06:55,227 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6361285198433998341_1060 size 1732
2013-10-31 16:06:55,227 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split from client DFSClient_1457307213
2013-10-31 16:06:55,228 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split is closed by DFSClient_1457307213
2013-10-31 16:06:55,228 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split. New replication is 10
2013-10-31 16:06:55,229 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6361285198433998341_1060 size 1732
2013-10-31 16:06:55,230 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6361285198433998341_1060 size 1732
2013-10-31 16:06:55,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split	dst=null	perm=null
2013-10-31 16:06:55,240 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split. blk_5739859526044531261_1061
2013-10-31 16:06:55,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,243 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5739859526044531261_1061 src: /127.0.0.1:54080 dest: /127.0.0.1:41648
2013-10-31 16:06:55,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5739859526044531261_1061 src: /127.0.0.1:47078 dest: /127.0.0.1:47311
2013-10-31 16:06:55,246 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5739859526044531261_1061 src: /127.0.0.1:34046 dest: /127.0.0.1:38271
2013-10-31 16:06:55,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5739859526044531261_1061 src: /127.0.0.1:33978 dest: /127.0.0.1:50942
2013-10-31 16:06:55,251 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33978, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5739859526044531261_1061, duration: 89378
2013-10-31 16:06:55,252 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5739859526044531261_1061 terminating
2013-10-31 16:06:55,252 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34046, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5739859526044531261_1061, duration: 891264
2013-10-31 16:06:55,253 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5739859526044531261_1061 terminating
2013-10-31 16:06:55,253 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47078, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5739859526044531261_1061, duration: 1848442
2013-10-31 16:06:55,253 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5739859526044531261_1061 size 1732
2013-10-31 16:06:55,254 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5739859526044531261_1061 terminating
2013-10-31 16:06:55,254 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54080, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5739859526044531261_1061, duration: 2955114
2013-10-31 16:06:55,254 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5739859526044531261_1061 size 1732
2013-10-31 16:06:55,255 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_5739859526044531261_1061 terminating
2013-10-31 16:06:55,260 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5739859526044531261_1061 size 1732
2013-10-31 16:06:55,260 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split from client DFSClient_1457307213
2013-10-31 16:06:55,260 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split is closed by DFSClient_1457307213
2013-10-31 16:06:55,262 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5739859526044531261_1061 size 1732
2013-10-31 16:06:55,263 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0004
2013-10-31 16:06:55,264 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0004 being deleted.
2013-10-31 16:06:55,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,273 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo. blk_4742838560224575816_1062
2013-10-31 16:06:55,275 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4742838560224575816_1062 src: /127.0.0.1:33979 dest: /127.0.0.1:50942
2013-10-31 16:06:55,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,277 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4742838560224575816_1062 src: /127.0.0.1:47082 dest: /127.0.0.1:47311
2013-10-31 16:06:55,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4742838560224575816_1062 src: /127.0.0.1:34050 dest: /127.0.0.1:38271
2013-10-31 16:06:55,281 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34050, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4742838560224575816_1062, duration: 72558
2013-10-31 16:06:55,281 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4742838560224575816_1062 terminating
2013-10-31 16:06:55,282 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47082, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4742838560224575816_1062, duration: 903191
2013-10-31 16:06:55,282 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4742838560224575816_1062 terminating
2013-10-31 16:06:55,283 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4742838560224575816_1062 size 183
2013-10-31 16:06:55,283 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33979, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4742838560224575816_1062, duration: 1708273
2013-10-31 16:06:55,283 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4742838560224575816_1062 terminating
2013-10-31 16:06:55,285 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4742838560224575816_1062 size 183
2013-10-31 16:06:55,286 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:06:55,286 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:06:55,287 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4742838560224575816_1062 size 183
2013-10-31 16:06:55,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,298 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo. blk_-5582207694431061275_1063
2013-10-31 16:06:55,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5582207694431061275_1063 src: /127.0.0.1:34051 dest: /127.0.0.1:38271
2013-10-31 16:06:55,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,302 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5582207694431061275_1063 src: /127.0.0.1:33983 dest: /127.0.0.1:50942
2013-10-31 16:06:55,303 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5582207694431061275_1063 src: /127.0.0.1:47086 dest: /127.0.0.1:47311
2013-10-31 16:06:55,306 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47086, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5582207694431061275_1063, duration: 65716
2013-10-31 16:06:55,307 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5582207694431061275_1063 terminating
2013-10-31 16:06:55,307 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33983, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5582207694431061275_1063, duration: 1003375
2013-10-31 16:06:55,308 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5582207694431061275_1063 terminating
2013-10-31 16:06:55,308 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5582207694431061275_1063 size 183
2013-10-31 16:06:55,308 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34051, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5582207694431061275_1063, duration: 1812414
2013-10-31 16:06:55,309 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5582207694431061275_1063 terminating
2013-10-31 16:06:55,313 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5582207694431061275_1063 size 183
2013-10-31 16:06:55,314 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:06:55,314 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:06:55,316 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5582207694431061275_1063 size 183
2013-10-31 16:06:55,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,331 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml. blk_3866472487802171399_1064
2013-10-31 16:06:55,333 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866472487802171399_1064 src: /127.0.0.1:34054 dest: /127.0.0.1:38271
2013-10-31 16:06:55,335 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866472487802171399_1064 src: /127.0.0.1:33986 dest: /127.0.0.1:50942
2013-10-31 16:06:55,337 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866472487802171399_1064 src: /127.0.0.1:54092 dest: /127.0.0.1:41648
2013-10-31 16:06:55,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,340 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54092, dest: /127.0.0.1:41648, bytes: 28245, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3866472487802171399_1064, duration: 224320
2013-10-31 16:06:55,340 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3866472487802171399_1064 terminating
2013-10-31 16:06:55,341 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33986, dest: /127.0.0.1:50942, bytes: 28245, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3866472487802171399_1064, duration: 1034977
2013-10-31 16:06:55,341 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3866472487802171399_1064 terminating
2013-10-31 16:06:55,342 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34054, dest: /127.0.0.1:38271, bytes: 28245, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3866472487802171399_1064, duration: 1926582
2013-10-31 16:06:55,342 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3866472487802171399_1064 terminating
2013-10-31 16:06:55,344 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3866472487802171399_1064 size 28245
2013-10-31 16:06:55,344 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml from client DFSClient_1457307213
2013-10-31 16:06:55,345 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml is closed by DFSClient_1457307213
2013-10-31 16:06:55,345 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3866472487802171399_1064 size 28245
2013-10-31 16:06:55,346 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3866472487802171399_1064 size 28245
2013-10-31 16:06:55,350 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml. blk_-5721256196737463602_1064
2013-10-31 16:06:55,352 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5721256196737463602_1064 src: /127.0.0.1:47090 dest: /127.0.0.1:47311
2013-10-31 16:06:55,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5721256196737463602_1064 src: /127.0.0.1:34058 dest: /127.0.0.1:38271
2013-10-31 16:06:55,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5721256196737463602_1064 src: /127.0.0.1:33990 dest: /127.0.0.1:50942
2013-10-31 16:06:55,358 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33990, dest: /127.0.0.1:50942, bytes: 28237, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5721256196737463602_1064, duration: 214452
2013-10-31 16:06:55,359 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5721256196737463602_1064 terminating
2013-10-31 16:06:55,359 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34058, dest: /127.0.0.1:38271, bytes: 28237, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5721256196737463602_1064, duration: 1143355
2013-10-31 16:06:55,360 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5721256196737463602_1064 terminating
2013-10-31 16:06:55,360 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47090, dest: /127.0.0.1:47311, bytes: 28237, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5721256196737463602_1064, duration: 2003250
2013-10-31 16:06:55,360 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5721256196737463602_1064 terminating
2013-10-31 16:06:55,361 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5721256196737463602_1064 size 28237
2013-10-31 16:06:55,362 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5721256196737463602_1064 size 28237
2013-10-31 16:06:55,363 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml from client DFSClient_1457307213
2013-10-31 16:06:55,363 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml is closed by DFSClient_1457307213
2013-10-31 16:06:55,363 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5721256196737463602_1064 size 28237
2013-10-31 16:06:55,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml	dst=null	perm=null
2013-10-31 16:06:55,723 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33992, bytes: 28469, op: HDFS_READ, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3866472487802171399_1064, duration: 573505
2013-10-31 16:06:55,743 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0005: nMaps=5 nReduces=1 max=-1
2013-10-31 16:06:55,743 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0005 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:06:55,743 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0005
2013-10-31 16:06:55,743 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0005	RESULT=SUCCESS
2013-10-31 16:06:55,744 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0005
2013-10-31 16:06:55,746 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0005
2013-10-31 16:06:55,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml	dst=null	perm=null
2013-10-31 16:06:55,755 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47096, bytes: 28461, op: HDFS_READ, cliID: DFSClient_898051513, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5721256196737463602_1064, duration: 531928
2013-10-31 16:06:55,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,763 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0006: nMaps=5 nReduces=1 max=-1
2013-10-31 16:06:55,763 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0006 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:06:55,763 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0006	RESULT=SUCCESS
2013-10-31 16:06:55,763 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0006
2013-10-31 16:06:55,764 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0006
2013-10-31 16:06:55,765 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0006
2013-10-31 16:06:55,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,784 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_conf.xml. blk_7203448194588732562_1068
2013-10-31 16:06:55,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,786 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7203448194588732562_1068 src: /127.0.0.1:33995 dest: /127.0.0.1:50942
2013-10-31 16:06:55,787 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7203448194588732562_1068 src: /127.0.0.1:47098 dest: /127.0.0.1:47311
2013-10-31 16:06:55,788 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_conf.xml. blk_6149960951356387480_1068
2013-10-31 16:06:55,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7203448194588732562_1068 src: /127.0.0.1:54102 dest: /127.0.0.1:41648
2013-10-31 16:06:55,791 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6149960951356387480_1068 src: /127.0.0.1:47100 dest: /127.0.0.1:47311
2013-10-31 16:06:55,792 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54102, dest: /127.0.0.1:41648, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7203448194588732562_1068, duration: 941377
2013-10-31 16:06:55,792 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6149960951356387480_1068 src: /127.0.0.1:34068 dest: /127.0.0.1:38271
2013-10-31 16:06:55,792 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7203448194588732562_1068 terminating
2013-10-31 16:06:55,792 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47098, dest: /127.0.0.1:47311, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7203448194588732562_1068, duration: 1348107
2013-10-31 16:06:55,793 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7203448194588732562_1068 terminating
2013-10-31 16:06:55,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33995, dest: /127.0.0.1:50942, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7203448194588732562_1068, duration: 2245887
2013-10-31 16:06:55,793 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7203448194588732562_1068 terminating
2013-10-31 16:06:55,794 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6149960951356387480_1068 src: /127.0.0.1:54105 dest: /127.0.0.1:41648
2013-10-31 16:06:55,797 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7203448194588732562_1068 size 28310
2013-10-31 16:06:55,797 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7203448194588732562_1068 size 28310
2013-10-31 16:06:55,798 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7203448194588732562_1068 size 28310
2013-10-31 16:06:55,798 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54105, dest: /127.0.0.1:41648, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6149960951356387480_1068, duration: 1908372
2013-10-31 16:06:55,798 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6149960951356387480_1068 terminating
2013-10-31 16:06:55,798 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34068, dest: /127.0.0.1:38271, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6149960951356387480_1068, duration: 902075
2013-10-31 16:06:55,799 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6149960951356387480_1068 terminating
2013-10-31 16:06:55,799 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47100, dest: /127.0.0.1:47311, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6149960951356387480_1068, duration: 3095961
2013-10-31 16:06:55,799 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6149960951356387480_1068 terminating
2013-10-31 16:06:55,801 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6149960951356387480_1068 size 28302
2013-10-31 16:06:55,802 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6149960951356387480_1068 size 28302
2013-10-31 16:06:55,803 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6149960951356387480_1068 size 28302
2013-10-31 16:06:56,196 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_conf.xml from client DFSClient_-63336241
2013-10-31 16:06:56,197 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_conf.xml is closed by DFSClient_-63336241
2013-10-31 16:06:56,202 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_conf.xml from client DFSClient_898051513
2013-10-31 16:06:56,202 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_conf.xml is closed by DFSClient_898051513
2013-10-31 16:06:56,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:56,218 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken. blk_604723262076837153_1070
2013-10-31 16:06:56,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_604723262076837153_1070 src: /127.0.0.1:47103 dest: /127.0.0.1:47311
2013-10-31 16:06:56,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:56,221 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_604723262076837153_1070 src: /127.0.0.1:34002 dest: /127.0.0.1:50942
2013-10-31 16:06:56,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_604723262076837153_1070 src: /127.0.0.1:54108 dest: /127.0.0.1:41648
2013-10-31 16:06:56,276 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54108, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_604723262076837153_1070, duration: 402895
2013-10-31 16:06:56,276 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_604723262076837153_1070 terminating
2013-10-31 16:06:56,276 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_604723262076837153_1070 size 116
2013-10-31 16:06:56,277 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34002, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_604723262076837153_1070, duration: 2510016
2013-10-31 16:06:56,277 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken. blk_1639395190201929201_1070
2013-10-31 16:06:56,277 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_604723262076837153_1070 terminating
2013-10-31 16:06:56,277 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47103, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_604723262076837153_1070, duration: 3035246
2013-10-31 16:06:56,278 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_604723262076837153_1070 terminating
2013-10-31 16:06:56,279 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken from client DFSClient_1457307213
2013-10-31 16:06:56,279 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken is closed by DFSClient_1457307213
2013-10-31 16:06:56,279 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1639395190201929201_1070 src: /127.0.0.1:34004 dest: /127.0.0.1:50942
2013-10-31 16:06:56,280 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1639395190201929201_1070 src: /127.0.0.1:34074 dest: /127.0.0.1:38271
2013-10-31 16:06:56,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1639395190201929201_1070 src: /127.0.0.1:54111 dest: /127.0.0.1:41648
2013-10-31 16:06:56,281 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_604723262076837153_1070 size 116
2013-10-31 16:06:56,281 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_604723262076837153_1070 size 116
2013-10-31 16:06:56,282 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54111, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1639395190201929201_1070, duration: 27172
2013-10-31 16:06:56,282 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1639395190201929201_1070 terminating
2013-10-31 16:06:56,282 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34074, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1639395190201929201_1070, duration: 378659
2013-10-31 16:06:56,283 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1639395190201929201_1070 terminating
2013-10-31 16:06:56,283 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken
2013-10-31 16:06:56,283 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34004, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1639395190201929201_1070, duration: 819815
2013-10-31 16:06:56,283 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1639395190201929201_1070 terminating
2013-10-31 16:06:56,284 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1639395190201929201_1070 size 116
2013-10-31 16:06:56,284 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken from client DFSClient_1457307213
2013-10-31 16:06:56,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:06:56,285 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken is closed by DFSClient_1457307213
2013-10-31 16:06:56,285 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1639395190201929201_1070 size 116
2013-10-31 16:06:56,286 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34007, bytes: 187, op: HDFS_READ, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4742838560224575816_1062, duration: 141688
2013-10-31 16:06:56,286 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1639395190201929201_1070 size 116
2013-10-31 16:06:56,287 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0005 = 19. Number of splits = 5
2013-10-31 16:06:56,287 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,287 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,287 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,289 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,289 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,289 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,289 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0005 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:06:56,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:06:56,289 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0005 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:06:56,290 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47110, bytes: 187, op: HDFS_READ, cliID: DFSClient_898051513, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5582207694431061275_1063, duration: 322533
2013-10-31 16:06:56,292 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0006 = 19. Number of splits = 5
2013-10-31 16:06:56,292 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,294 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,294 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,294 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,294 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,296 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0006 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:06:56,296 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0006 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:06:56,667 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2374554834453302461_1046 file build/test/data/dfs/data/data2/current/blk_-2374554834453302461 for deletion
2013-10-31 16:06:56,667 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4985515153484692347_1045 file build/test/data/dfs/data/data1/current/blk_4985515153484692347 for deletion
2013-10-31 16:06:56,667 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2374554834453302461_1046 at file build/test/data/dfs/data/data2/current/blk_-2374554834453302461
2013-10-31 16:06:56,667 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7721447327930509679_1044 file build/test/data/dfs/data/data2/current/blk_7721447327930509679 for deletion
2013-10-31 16:06:56,668 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4985515153484692347_1045 at file build/test/data/dfs/data/data1/current/blk_4985515153484692347
2013-10-31 16:06:56,668 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7721447327930509679_1044 at file build/test/data/dfs/data/data2/current/blk_7721447327930509679
2013-10-31 16:06:57,169 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-8532132085552426957_1057 to datanode(s) 127.0.0.1:50942
2013-10-31 16:06:57,170 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_6795492832038410935_1058 to datanode(s) 127.0.0.1:38271
2013-10-31 16:06:57,170 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_7011938532533120784_1050
2013-10-31 16:06:57,170 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_7011938532533120784_1050
2013-10-31 16:06:57,240 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0005_m_000006_0' to tip task_20131031160444934_0005_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:57,246 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000000_0'
2013-10-31 16:06:57,246 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000001_0'
2013-10-31 16:06:57,246 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000006_0'
2013-10-31 16:06:57,248 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:06:57,248 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000006_0 which needs 1 slots
2013-10-31 16:06:57,248 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000006_0 which needs 1 slots
2013-10-31 16:06:57,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken	dst=null	perm=null
2013-10-31 16:06:57,259 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34009, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_604723262076837153_1070, duration: 350810
2013-10-31 16:06:57,267 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7011938532533120784_1050 file build/test/data/dfs/data/data3/current/blk_7011938532533120784 for deletion
2013-10-31 16:06:57,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml	dst=null	perm=null
2013-10-31 16:06:57,267 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7011938532533120784_1050 at file build/test/data/dfs/data/data3/current/blk_7011938532533120784
2013-10-31 16:06:57,272 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34011, bytes: 28469, op: HDFS_READ, cliID: DFSClient_-457764543, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3866472487802171399_1064, duration: 489355
2013-10-31 16:06:57,302 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:57,325 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0006_m_000006_0' to tip task_20131031160444934_0006_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:57,334 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:06:57,334 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000006_0 which needs 1 slots
2013-10-31 16:06:57,334 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_m_000006_0 which needs 1 slots
2013-10-31 16:06:57,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken	dst=null	perm=null
2013-10-31 16:06:57,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34012, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1639395190201929201_1070, duration: 330234
2013-10-31 16:06:57,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar	dst=null	perm=null
2013-10-31 16:06:57,352 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47116, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-457764543, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8532132085552426957_1057, duration: 1172812
2013-10-31 16:06:57,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml	dst=null	perm=null
2013-10-31 16:06:57,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34015, bytes: 28461, op: HDFS_READ, cliID: DFSClient_1738221783, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5721256196737463602_1064, duration: 496972
2013-10-31 16:06:57,372 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:57,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar	dst=null	perm=null
2013-10-31 16:06:57,388 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47118, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1738221783, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6795492832038410935_1058, duration: 827545
2013-10-31 16:06:57,408 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0004_m_-1151283590
2013-10-31 16:06:57,413 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11777 with signal TERM. Exit code 0
2013-10-31 16:06:57,413 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-126897438
2013-10-31 16:06:57,414 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-126897438 spawned.
2013-10-31 16:06:57,415 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000006_0/taskjvm.sh
2013-10-31 16:06:57,445 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0004_m_-2130177320
2013-10-31 16:06:57,450 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12015 with signal TERM. Exit code 0
2013-10-31 16:06:57,450 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_1013282559
2013-10-31 16:06:57,450 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_1013282559 spawned.
2013-10-31 16:06:57,452 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000006_0/taskjvm.sh
2013-10-31 16:06:57,512 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:57,512 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:57,512 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:57,513 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_-2130177320 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:57,880 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-8532132085552426957_1057 to 127.0.0.1:50942 
2013-10-31 16:06:57,881 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_6795492832038410935_1058 to 127.0.0.1:38271 
2013-10-31 16:06:57,881 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7011938532533120784_1050 file build/test/data/dfs/data/data5/current/blk_7011938532533120784 for deletion
2013-10-31 16:06:57,882 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7011938532533120784_1050 at file build/test/data/dfs/data/data5/current/blk_7011938532533120784
2013-10-31 16:06:57,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8532132085552426957_1057 src: /127.0.0.1:34017 dest: /127.0.0.1:50942
2013-10-31 16:06:57,883 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-8532132085552426957_1057 to /127.0.0.1:50942
2013-10-31 16:06:57,883 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_6795492832038410935_1058 to /127.0.0.1:38271
2013-10-31 16:06:57,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6795492832038410935_1058 src: /127.0.0.1:34086 dest: /127.0.0.1:38271
2013-10-31 16:06:57,888 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8532132085552426957_1057 src: /127.0.0.1:34017 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:06:57,889 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6795492832038410935_1058 src: /127.0.0.1:34086 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:06:57,890 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8532132085552426957_1057 size 238055
2013-10-31 16:06:57,892 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6795492832038410935_1058 size 238055
2013-10-31 16:06:58,271 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:58,271 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:58,271 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:06:58,271 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_-1151283590 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:06:59,034 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-126897438 given task: attempt_20131031160444934_0005_m_000006_0
2013-10-31 16:06:59,209 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_1013282559 given task: attempt_20131031160444934_0006_m_000006_0
2013-10-31 16:06:59,318 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0004
2013-10-31 16:06:59,319 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000002_0 not found in cache
2013-10-31 16:06:59,319 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000003_0 not found in cache
2013-10-31 16:06:59,319 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000005_0 not found in cache
2013-10-31 16:06:59,319 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0004 for user-log deletion with retainTimeStamp:1383322019319
2013-10-31 16:06:59,497 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0004
2013-10-31 16:06:59,497 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000004_0 not found in cache
2013-10-31 16:06:59,498 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0004 for user-log deletion with retainTimeStamp:1383322019498
2013-10-31 16:06:59,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:59,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:00,052 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0004_m_-1475551417 since job job_20131031160444934_0004 is dead
2013-10-31 16:07:00,059 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12014 with signal TERM. Exit code 0
2013-10-31 16:07:00,171 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_7011938532533120784_1050
2013-10-31 16:07:00,211 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:00,212 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:00,212 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:00,213 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_-1475551417 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:07:00,969 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0004_m_2107520939 since job job_20131031160444934_0004 is dead
2013-10-31 16:07:00,980 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12013 with signal TERM. Exit code 0
2013-10-31 16:07:01,155 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:01,155 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:01,155 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:01,156 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_2107520939 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:02,248 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0004
2013-10-31 16:07:02,249 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000001_0 not found in cache
2013-10-31 16:07:02,249 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000000_0 not found in cache
2013-10-31 16:07:02,249 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0004 for user-log deletion with retainTimeStamp:1383322022249
2013-10-31 16:07:02,496 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000006_0 0.0% setup
2013-10-31 16:07:02,498 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000006_0 is done.
2013-10-31 16:07:02,499 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000006_0  was -1
2013-10-31 16:07:02,499 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:02,627 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000006_0 0.0% setup
2013-10-31 16:07:02,629 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000006_0 is done.
2013-10-31 16:07:02,630 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000006_0  was -1
2013-10-31 16:07:02,630 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:02,871 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7011938532533120784_1050 file build/test/data/dfs/data/data8/current/blk_7011938532533120784 for deletion
2013-10-31 16:07:02,871 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7011938532533120784_1050 at file build/test/data/dfs/data/data8/current/blk_7011938532533120784
2013-10-31 16:07:03,253 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000006_0' has completed task_20131031160444934_0005_m_000006 successfully.
2013-10-31 16:07:03,292 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0004_m_-389116012 since job job_20131031160444934_0004 is dead
2013-10-31 16:07:03,299 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11976 with signal TERM. Exit code 0
2013-10-31 16:07:03,419 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000000_0' to tip task_20131031160444934_0005_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:03,422 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000000
2013-10-31 16:07:03,423 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000001_0' to tip task_20131031160444934_0005_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:03,423 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000001
2013-10-31 16:07:03,424 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000006_0' has completed task_20131031160444934_0006_m_000006 successfully.
2013-10-31 16:07:03,426 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:03,427 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:07:03,428 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000002_0' to tip task_20131031160444934_0005_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:07:03,428 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000000_0 which needs 1 slots
2013-10-31 16:07:03,428 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000000_0 which needs 1 slots
2013-10-31 16:07:03,428 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000002
2013-10-31 16:07:03,428 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000001_0 which needs 1 slots
2013-10-31 16:07:03,429 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000003_0' to tip task_20131031160444934_0005_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:07:03,429 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0005_m_000001_0 which needs 1 slots
2013-10-31 16:07:03,432 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000003
2013-10-31 16:07:03,437 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:07:03,438 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:07:03,438 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000002_0 which needs 1 slots
2013-10-31 16:07:03,439 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000002_0 which needs 1 slots
2013-10-31 16:07:03,439 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000003_0 which needs 1 slots
2013-10-31 16:07:03,439 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0005_m_000003_0 which needs 1 slots
2013-10-31 16:07:03,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken	dst=null	perm=null
2013-10-31 16:07:03,452 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47126, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_604723262076837153_1070, duration: 334869
2013-10-31 16:07:03,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml	dst=null	perm=null
2013-10-31 16:07:03,469 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34026, bytes: 28469, op: HDFS_READ, cliID: DFSClient_403873195, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3866472487802171399_1064, duration: 393740
2013-10-31 16:07:03,506 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000004_0' to tip task_20131031160444934_0005_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:07:03,507 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000004
2013-10-31 16:07:03,507 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000000_0' to tip task_20131031160444934_0006_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:07:03,508 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000000
2013-10-31 16:07:03,509 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:07:03,510 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:03,510 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000004_0 which needs 1 slots
2013-10-31 16:07:03,510 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000004_0 which needs 1 slots
2013-10-31 16:07:03,511 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000000_0 which needs 1 slots
2013-10-31 16:07:03,511 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0006_m_000000_0 which needs 1 slots
2013-10-31 16:07:03,590 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:03,592 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:03,593 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:03,593 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:03,595 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_-389116012 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:03,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken	dst=null	perm=null
2013-10-31 16:07:03,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken	dst=null	perm=null
2013-10-31 16:07:03,597 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-751621141
2013-10-31 16:07:03,598 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-751621141 spawned.
2013-10-31 16:07:03,600 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0005/attempt_20131031160444934_0005_m_000000_0. Attempting to reuse: jvm_20131031160444934_0005_m_-126897438
2013-10-31 16:07:03,603 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47129, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_604723262076837153_1070, duration: 355448
2013-10-31 16:07:03,604 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000001_0/taskjvm.sh
2013-10-31 16:07:03,604 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54133, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1639395190201929201_1070, duration: 324787
2013-10-31 16:07:03,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml	dst=null	perm=null
2013-10-31 16:07:03,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml	dst=null	perm=null
2013-10-31 16:07:03,618 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34100, bytes: 28469, op: HDFS_READ, cliID: DFSClient_-744342643, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3866472487802171399_1064, duration: 432017
2013-10-31 16:07:03,618 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47134, bytes: 28461, op: HDFS_READ, cliID: DFSClient_1701704566, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5721256196737463602_1064, duration: 444225
2013-10-31 16:07:03,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar	dst=null	perm=null
2013-10-31 16:07:03,636 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34033, bytes: 239915, op: HDFS_READ, cliID: DFSClient_403873195, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8532132085552426957_1057, duration: 2134137
2013-10-31 16:07:03,640 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:03,642 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:03,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar	dst=null	perm=null
2013-10-31 16:07:03,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar	dst=null	perm=null
2013-10-31 16:07:03,656 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47136, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1701704566, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6795492832038410935_1058, duration: 820328
2013-10-31 16:07:03,657 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47137, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-744342643, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8532132085552426957_1057, duration: 851382
2013-10-31 16:07:03,810 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-921563826
2013-10-31 16:07:03,811 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-921563826 spawned.
2013-10-31 16:07:03,811 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0006_m_1013282559
2013-10-31 16:07:03,813 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000003_0/taskjvm.sh
2013-10-31 16:07:03,816 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12523 with signal TERM. Exit code 0
2013-10-31 16:07:03,816 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-919387719
2013-10-31 16:07:03,816 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-919387719 spawned.
2013-10-31 16:07:03,817 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000002_0/taskjvm.sh
2013-10-31 16:07:03,838 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_80173135
2013-10-31 16:07:03,839 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_80173135 spawned.
2013-10-31 16:07:03,839 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-406446409
2013-10-31 16:07:03,839 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-406446409 spawned.
2013-10-31 16:07:03,840 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000000_0/taskjvm.sh
2013-10-31 16:07:03,840 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000004_0/taskjvm.sh
2013-10-31 16:07:03,881 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:03,881 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:03,881 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:03,881 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_1013282559 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:04,063 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-126897438 given task: attempt_20131031160444934_0005_m_000000_0
2013-10-31 16:07:04,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split	dst=null	perm=null
2013-10-31 16:07:04,170 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47139, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6361285198433998341_1060, duration: 186228
2013-10-31 16:07:04,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:07:04,272 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000001_0' to tip task_20131031160444934_0006_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:07:04,273 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000001
2013-10-31 16:07:04,273 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000002_0' to tip task_20131031160444934_0006_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:07:04,273 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000002
2013-10-31 16:07:04,274 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:07:04,275 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:07:04,275 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000001_0 which needs 1 slots
2013-10-31 16:07:04,275 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_m_000001_0 which needs 1 slots
2013-10-31 16:07:04,275 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000002_0 which needs 1 slots
2013-10-31 16:07:04,275 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0006_m_000002_0 which needs 1 slots
2013-10-31 16:07:04,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken	dst=null	perm=null
2013-10-31 16:07:04,280 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34107, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1639395190201929201_1070, duration: 149635
2013-10-31 16:07:04,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml	dst=null	perm=null
2013-10-31 16:07:04,285 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34040, bytes: 28461, op: HDFS_READ, cliID: DFSClient_779080697, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5721256196737463602_1064, duration: 177880
2013-10-31 16:07:04,298 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:04,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar	dst=null	perm=null
2013-10-31 16:07:04,314 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34110, bytes: 239915, op: HDFS_READ, cliID: DFSClient_779080697, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6795492832038410935_1058, duration: 820709
2013-10-31 16:07:04,374 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_-245324502
2013-10-31 16:07:04,375 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_-245324502 spawned.
2013-10-31 16:07:04,375 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_-1130629699
2013-10-31 16:07:04,376 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_-1130629699 spawned.
2013-10-31 16:07:04,376 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000001_0/taskjvm.sh
2013-10-31 16:07:04,377 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000002_0/taskjvm.sh
2013-10-31 16:07:04,516 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47145, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 142662
2013-10-31 16:07:04,578 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-751621141 given task: attempt_20131031160444934_0005_m_000001_0
2013-10-31 16:07:05,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split	dst=null	perm=null
2013-10-31 16:07:05,329 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54151, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6361285198433998341_1060, duration: 207707
2013-10-31 16:07:05,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:07:05,370 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47149, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 144536
2013-10-31 16:07:05,460 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-921563826 given task: attempt_20131031160444934_0005_m_000003_0
2013-10-31 16:07:05,771 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-406446409 given task: attempt_20131031160444934_0005_m_000004_0
2013-10-31 16:07:05,773 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-919387719 given task: attempt_20131031160444934_0005_m_000002_0
2013-10-31 16:07:05,777 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_-1130629699 given task: attempt_20131031160444934_0006_m_000002_0
2013-10-31 16:07:05,799 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_80173135 given task: attempt_20131031160444934_0006_m_000000_0
2013-10-31 16:07:05,842 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_-245324502 given task: attempt_20131031160444934_0006_m_000001_0
2013-10-31 16:07:06,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split	dst=null	perm=null
2013-10-31 16:07:06,042 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54159, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6361285198433998341_1060, duration: 278615
2013-10-31 16:07:06,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:07:06,084 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34055, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 148978
2013-10-31 16:07:06,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split	dst=null	perm=null
2013-10-31 16:07:06,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split	dst=null	perm=null
2013-10-31 16:07:06,295 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47161, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6361285198433998341_1060, duration: 252782
2013-10-31 16:07:06,296 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54165, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6361285198433998341_1060, duration: 168356
2013-10-31 16:07:06,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split	dst=null	perm=null
2013-10-31 16:07:06,327 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47164, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5739859526044531261_1061, duration: 188620
2013-10-31 16:07:06,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:07:06,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:07:06,335 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47165, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 140531
2013-10-31 16:07:06,336 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34064, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 110033
2013-10-31 16:07:06,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:07:06,370 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34135, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 166825
2013-10-31 16:07:06,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split	dst=null	perm=null
2013-10-31 16:07:06,386 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34136, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5739859526044531261_1061, duration: 221796
2013-10-31 16:07:06,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:07:06,428 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47170, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 176715
2013-10-31 16:07:06,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split	dst=null	perm=null
2013-10-31 16:07:06,441 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34138, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5739859526044531261_1061, duration: 186317
2013-10-31 16:07:06,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:07:06,730 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34070, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 152392
2013-10-31 16:07:07,134 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:07:07,137 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000000_0 is done.
2013-10-31 16:07:07,138 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000000_0  was 23
2013-10-31 16:07:07,138 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:08,253 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:07:08,256 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000001_0 is done.
2013-10-31 16:07:08,256 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000001_0  was 23
2013-10-31 16:07:08,257 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:08,428 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0005_m_000006_0
2013-10-31 16:07:08,428 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0005_m_000006_0
2013-10-31 16:07:08,428 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0005_m_000006_0 not found in cache
2013-10-31 16:07:08,438 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0006_m_000006_0
2013-10-31 16:07:08,439 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0006_m_000006_0
2013-10-31 16:07:08,439 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0006_m_000006_0 not found in cache
2013-10-31 16:07:08,957 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:07:08,959 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000003_0 is done.
2013-10-31 16:07:08,960 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000003_0  was 23
2013-10-31 16:07:08,960 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:09,220 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:07:09,222 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000002_0 is done.
2013-10-31 16:07:09,223 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000002_0  was 23
2013-10-31 16:07:09,223 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:09,224 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:07:09,226 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000004_0 is done.
2013-10-31 16:07:09,226 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000004_0  was 23
2013-10-31 16:07:09,227 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:09,250 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:07:09,251 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000002_0 is done.
2013-10-31 16:07:09,251 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000002_0  was 23
2013-10-31 16:07:09,251 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:09,310 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:07:09,313 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000001_0 is done.
2013-10-31 16:07:09,313 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000001_0  was 23
2013-10-31 16:07:09,313 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:09,367 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:07:09,369 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000000_0 is done.
2013-10-31 16:07:09,369 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000000_0  was 23
2013-10-31 16:07:09,369 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:09,431 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000000_0' has completed task_20131031160444934_0005_m_000000 successfully.
2013-10-31 16:07:09,432 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000001_0' has completed task_20131031160444934_0005_m_000001 successfully.
2013-10-31 16:07:09,434 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000003_0' to tip task_20131031160444934_0006_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:09,435 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000003
2013-10-31 16:07:09,435 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000004_0' to tip task_20131031160444934_0006_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:09,436 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000004
2013-10-31 16:07:09,445 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0005_r_000000_0' to tip task_20131031160444934_0005_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:09,447 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000002_0' has completed task_20131031160444934_0005_m_000002 successfully.
2013-10-31 16:07:09,448 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:07:09,450 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:07:09,450 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000003_0 which needs 1 slots
2013-10-31 16:07:09,451 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:09,451 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_m_000003_0 which needs 1 slots
2013-10-31 16:07:09,451 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000003_0' has completed task_20131031160444934_0005_m_000003 successfully.
2013-10-31 16:07:09,451 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_r_000000_0 which needs 1 slots
2013-10-31 16:07:09,452 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000004_0 which needs 1 slots
2013-10-31 16:07:09,452 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_r_000000_0 which needs 1 slots
2013-10-31 16:07:09,452 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0006_m_000004_0 which needs 1 slots
2013-10-31 16:07:09,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken	dst=null	perm=null
2013-10-31 16:07:09,464 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34140, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1639395190201929201_1070, duration: 318447
2013-10-31 16:07:09,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml	dst=null	perm=null
2013-10-31 16:07:09,476 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34142, bytes: 28461, op: HDFS_READ, cliID: DFSClient_1439700524, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5721256196737463602_1064, duration: 450463
2013-10-31 16:07:09,516 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000004_0' has completed task_20131031160444934_0005_m_000004 successfully.
2013-10-31 16:07:09,518 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000000_0' has completed task_20131031160444934_0006_m_000000 successfully.
2013-10-31 16:07:09,520 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0006_r_000000_0' to tip task_20131031160444934_0006_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:07:09,523 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_r_1565160902
2013-10-31 16:07:09,524 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_r_1565160902 spawned.
2013-10-31 16:07:09,525 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:09,525 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_r_000000_0 which needs 1 slots
2013-10-31 16:07:09,526 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_r_000000_0 which needs 1 slots
2013-10-31 16:07:09,531 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_r_000000_0/taskjvm.sh
2013-10-31 16:07:09,558 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_r_-541739399
2013-10-31 16:07:09,559 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_r_-541739399 spawned.
2013-10-31 16:07:09,562 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_r_000000_0/taskjvm.sh
2013-10-31 16:07:09,727 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:09,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar	dst=null	perm=null
2013-10-31 16:07:09,760 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47176, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1439700524, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6795492832038410935_1058, duration: 1419735
2013-10-31 16:07:09,850 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0005_m_-751621141
2013-10-31 16:07:09,858 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12689 with signal TERM. Exit code 0
2013-10-31 16:07:09,858 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_-861004426
2013-10-31 16:07:09,859 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_-861004426 spawned.
2013-10-31 16:07:09,859 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0005_m_-126897438
2013-10-31 16:07:09,861 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000004_0/taskjvm.sh
2013-10-31 16:07:09,870 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12480 with signal TERM. Exit code 0
2013-10-31 16:07:09,870 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_1282739064
2013-10-31 16:07:09,871 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_1282739064 spawned.
2013-10-31 16:07:09,873 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000003_0/taskjvm.sh
2013-10-31 16:07:09,936 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:09,936 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:09,936 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:09,936 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-126897438 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:07:09,956 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:09,957 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:09,957 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:09,957 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-751621141 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:10,279 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000001_0' has completed task_20131031160444934_0006_m_000001 successfully.
2013-10-31 16:07:10,280 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000002_0' has completed task_20131031160444934_0006_m_000002 successfully.
2013-10-31 16:07:10,672 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_r_-541739399 given task: attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:10,742 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_r_1565160902 given task: attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:10,853 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_1282739064 given task: attempt_20131031160444934_0006_m_000003_0
2013-10-31 16:07:10,866 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_-861004426 given task: attempt_20131031160444934_0006_m_000004_0
2013-10-31 16:07:11,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split	dst=null	perm=null
2013-10-31 16:07:11,377 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34152, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5739859526044531261_1061, duration: 177859
2013-10-31 16:07:11,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split	dst=null	perm=null
2013-10-31 16:07:11,387 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34084, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5739859526044531261_1061, duration: 169028
2013-10-31 16:07:11,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:07:11,416 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34085, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 114033
2013-10-31 16:07:11,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:07:11,426 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34155, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 140159
2013-10-31 16:07:14,305 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:07:14,308 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000004_0 is done.
2013-10-31 16:07:14,309 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000004_0  was 23
2013-10-31 16:07:14,309 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:14,316 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:07:14,318 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000003_0 is done.
2013-10-31 16:07:14,319 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000003_0  was 23
2013-10-31 16:07:14,319 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:15,456 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000003_0' has completed task_20131031160444934_0006_m_000003 successfully.
2013-10-31 16:07:15,661 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000004_0' has completed task_20131031160444934_0006_m_000004 successfully.
2013-10-31 16:07:16,396 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:46687, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000000_0, duration: 16858411
2013-10-31 16:07:16,408 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57813, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000000_0, duration: 9184223
2013-10-31 16:07:16,414 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:45882, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000001_0, duration: 7850020
2013-10-31 16:07:16,422 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57813, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000001_0, duration: 6610592
2013-10-31 16:07:16,423 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:45882, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000002_0, duration: 5939610
2013-10-31 16:07:16,436 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42017, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000002_0, duration: 9784582
2013-10-31 16:07:16,452 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42017, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000003_0, duration: 11872954
2013-10-31 16:07:16,469 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:46691, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000004_0, duration: 12420930
2013-10-31 16:07:17,162 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) > 
2013-10-31 16:07:17,231 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:07:17,286 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:07:17,344 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:07:17,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:17,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:17,835 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000. blk_2997245466678193792_1071
2013-10-31 16:07:17,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2997245466678193792_1071 src: /127.0.0.1:34093 dest: /127.0.0.1:50942
2013-10-31 16:07:17,881 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2997245466678193792_1071 src: /127.0.0.1:54199 dest: /127.0.0.1:41648
2013-10-31 16:07:17,882 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2997245466678193792_1071 src: /127.0.0.1:47197 dest: /127.0.0.1:47311
2013-10-31 16:07:17,887 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47197, dest: /127.0.0.1:47311, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0005_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2997245466678193792_1071, duration: 2390734
2013-10-31 16:07:17,888 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2997245466678193792_1071 terminating
2013-10-31 16:07:17,888 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54199, dest: /127.0.0.1:41648, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0005_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2997245466678193792_1071, duration: 4182145
2013-10-31 16:07:17,888 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2997245466678193792_1071 terminating
2013-10-31 16:07:17,889 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34093, dest: /127.0.0.1:50942, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0005_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2997245466678193792_1071, duration: 4443919
2013-10-31 16:07:17,889 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2997245466678193792_1071 terminating
2013-10-31 16:07:17,892 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2997245466678193792_1071 size 180
2013-10-31 16:07:17,892 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2997245466678193792_1071 size 180
2013-10-31 16:07:17,892 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2997245466678193792_1071 size 180
2013-10-31 16:07:17,892 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:17,893 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:17,928 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0005_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:07:17,928 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:07:18,668 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031160444934_0005_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:43831
2013-10-31 16:07:18,672 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:18,672 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   3 OK for attempt_20131031160444934_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:07:18,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0	dst=null	perm=null
2013-10-31 16:07:18,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:18,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:18,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0	dst=null	perm=null
2013-10-31 16:07:20,212 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) > 
2013-10-31 16:07:20,276 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 16:07:20,279 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 16:07:20,280 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_r_000000_0 is done.
2013-10-31 16:07:20,280 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_r_000000_0  was -1
2013-10-31 16:07:20,282 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:21,446 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57821, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000003_0, duration: 14308681
2013-10-31 16:07:21,461 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57821, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000004_0, duration: 11792784
2013-10-31 16:07:21,675 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_r_000000_0' has completed task_20131031160444934_0005_r_000000 successfully.
2013-10-31 16:07:21,681 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0005_m_000005_0' to tip task_20131031160444934_0005_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:21,684 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:07:21,684 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000005_0 which needs 1 slots
2013-10-31 16:07:21,684 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000005_0 which needs 1 slots
2013-10-31 16:07:21,716 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0006_m_-861004426
2013-10-31 16:07:21,723 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13314 with signal TERM. Exit code 0
2013-10-31 16:07:21,723 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_527717294
2013-10-31 16:07:21,723 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_527717294 spawned.
2013-10-31 16:07:21,726 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000005_0/taskjvm.sh
2013-10-31 16:07:21,839 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:21,840 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:21,840 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:21,840 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_-861004426 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:22,220 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) > 
2013-10-31 16:07:22,276 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) > 
2013-10-31 16:07:22,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:22,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:22,497 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000. blk_2693516798230755184_1072
2013-10-31 16:07:22,519 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2693516798230755184_1072 src: /127.0.0.1:54203 dest: /127.0.0.1:41648
2013-10-31 16:07:22,520 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2693516798230755184_1072 src: /127.0.0.1:34100 dest: /127.0.0.1:50942
2013-10-31 16:07:22,520 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2693516798230755184_1072 src: /127.0.0.1:34170 dest: /127.0.0.1:38271
2013-10-31 16:07:22,522 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34170, dest: /127.0.0.1:38271, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0006_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2693516798230755184_1072, duration: 1009448
2013-10-31 16:07:22,523 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2693516798230755184_1072 terminating
2013-10-31 16:07:22,523 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34100, dest: /127.0.0.1:50942, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0006_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2693516798230755184_1072, duration: 1458855
2013-10-31 16:07:22,523 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2693516798230755184_1072 terminating
2013-10-31 16:07:22,523 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54203, dest: /127.0.0.1:41648, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0006_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2693516798230755184_1072, duration: 1876655
2013-10-31 16:07:22,524 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2693516798230755184_1072 terminating
2013-10-31 16:07:22,525 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2693516798230755184_1072 size 180
2013-10-31 16:07:22,527 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2693516798230755184_1072 size 180
2013-10-31 16:07:22,527 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:22,527 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:22,527 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2693516798230755184_1072 size 180
2013-10-31 16:07:22,565 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0006_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:07:22,565 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) > 
2013-10-31 16:07:22,698 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_527717294 given task: attempt_20131031160444934_0005_m_000005_0
2013-10-31 16:07:23,197 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000005_0 0.0% 
2013-10-31 16:07:23,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary	dst=null	perm=null
2013-10-31 16:07:23,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:23,223 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_SUCCESS from client DFSClient_attempt_20131031160444934_0005_m_000005_0
2013-10-31 16:07:23,223 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0005_m_000005_0
2013-10-31 16:07:23,229 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8532132085552426957 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:23,229 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8532132085552426957 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:23,229 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8532132085552426957 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:23,229 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8532132085552426957 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:23,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6361285198433998341 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:23,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6361285198433998341 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:23,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6361285198433998341 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:23,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6361285198433998341 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:23,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4742838560224575816 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:23,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4742838560224575816 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:23,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4742838560224575816 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:23,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3866472487802171399 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:23,232 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3866472487802171399 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:23,232 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3866472487802171399 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:23,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005	dst=null	perm=null
2013-10-31 16:07:24,177 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-8532132085552426957_1057 blk_3866472487802171399_1064 blk_-6361285198433998341_1060
2013-10-31 16:07:24,177 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-8532132085552426957_1057 blk_4742838560224575816_1062 blk_-6361285198433998341_1060
2013-10-31 16:07:24,276 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8532132085552426957_1057 file build/test/data/dfs/data/data4/current/blk_-8532132085552426957 for deletion
2013-10-31 16:07:24,276 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6361285198433998341_1060 file build/test/data/dfs/data/data4/current/blk_-6361285198433998341 for deletion
2013-10-31 16:07:24,276 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8532132085552426957_1057 at file build/test/data/dfs/data/data4/current/blk_-8532132085552426957
2013-10-31 16:07:24,276 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4742838560224575816_1062 file build/test/data/dfs/data/data4/current/blk_4742838560224575816 for deletion
2013-10-31 16:07:24,277 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6361285198433998341_1060 at file build/test/data/dfs/data/data4/current/blk_-6361285198433998341
2013-10-31 16:07:24,277 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4742838560224575816_1062 at file build/test/data/dfs/data/data4/current/blk_4742838560224575816
2013-10-31 16:07:24,690 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   2 OK for attempt_20131031160444934_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:07:24,691 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:24,889 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8532132085552426957_1057 file build/test/data/dfs/data/data5/current/blk_-8532132085552426957 for deletion
2013-10-31 16:07:24,889 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6361285198433998341_1060 file build/test/data/dfs/data/data5/current/blk_-6361285198433998341 for deletion
2013-10-31 16:07:24,889 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3866472487802171399_1064 file build/test/data/dfs/data/data5/current/blk_3866472487802171399 for deletion
2013-10-31 16:07:24,890 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8532132085552426957_1057 at file build/test/data/dfs/data/data5/current/blk_-8532132085552426957
2013-10-31 16:07:24,890 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6361285198433998341_1060 at file build/test/data/dfs/data/data5/current/blk_-6361285198433998341
2013-10-31 16:07:24,891 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3866472487802171399_1064 at file build/test/data/dfs/data/data5/current/blk_3866472487802171399
2013-10-31 16:07:25,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0	dst=null	perm=null
2013-10-31 16:07:25,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:25,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:25,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0	dst=null	perm=null
2013-10-31 16:07:26,130 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000005_0 0.0% cleanup
2013-10-31 16:07:26,132 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000005_0 is done.
2013-10-31 16:07:26,132 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000005_0  was -1
2013-10-31 16:07:26,132 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:26,268 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 16:07:26,270 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 16:07:26,272 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_r_000000_0 is done.
2013-10-31 16:07:26,272 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_r_000000_0  was -1
2013-10-31 16:07:26,273 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:26,684 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:26,685 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:27,178 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-8532132085552426957_1057 blk_3866472487802171399_1064 blk_4742838560224575816_1062 blk_-6361285198433998341_1060
2013-10-31 16:07:27,178 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-8532132085552426957_1057 blk_3866472487802171399_1064 blk_4742838560224575816_1062 blk_-6361285198433998341_1060
2013-10-31 16:07:27,692 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000005_0' has completed task_20131031160444934_0005_m_000005 successfully.
2013-10-31 16:07:27,921 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0005 has completed successfully.
2013-10-31 16:07:27,921 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0005,submitTime=1383235615711,launchTime=1383235616289,firstMapTaskLaunchTime=1383235623419,firstReduceTaskLaunchTime=1383235629436,firstJobSetupTaskLaunchTime=1383235617240,firstJobCleanupTaskLaunchTime=1383235641681,finishTime=1383235647921,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2CC911EB25C3440AB1D0D1C97C8C5190/6DA129A1920447BCB7A07D38023CB8FC] lower*upper/(1/3)
2013-10-31 16:07:27,928 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC. blk_-7119686764560670206_1073
2013-10-31 16:07:27,930 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119686764560670206_1073 src: /127.0.0.1:34175 dest: /127.0.0.1:38271
2013-10-31 16:07:27,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119686764560670206_1073 src: /127.0.0.1:54212 dest: /127.0.0.1:41648
2013-10-31 16:07:27,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119686764560670206_1073 src: /127.0.0.1:47210 dest: /127.0.0.1:47311
2013-10-31 16:07:27,957 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47210, dest: /127.0.0.1:47311, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7119686764560670206_1073, duration: 246968
2013-10-31 16:07:27,957 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7119686764560670206_1073 terminating
2013-10-31 16:07:27,958 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54212, dest: /127.0.0.1:41648, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7119686764560670206_1073, duration: 1044983
2013-10-31 16:07:27,958 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7119686764560670206_1073 terminating
2013-10-31 16:07:27,959 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34175, dest: /127.0.0.1:38271, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7119686764560670206_1073, duration: 1937524
2013-10-31 16:07:27,959 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7119686764560670206_1073 terminating
2013-10-31 16:07:27,961 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7119686764560670206_1073 size 31965
2013-10-31 16:07:27,961 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC from client DFSClient_-63336241
2013-10-31 16:07:27,962 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC is closed by DFSClient_-63336241
2013-10-31 16:07:27,963 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7119686764560670206_1073 size 31965
2013-10-31 16:07:27,963 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7119686764560670206_1073 size 31965
2013-10-31 16:07:27,968 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:27,970 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000000_0'
2013-10-31 16:07:27,970 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000001_0'
2013-10-31 16:07:27,972 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000005_0'
2013-10-31 16:07:27,972 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_604723262076837153 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:27,972 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000006_0'
2013-10-31 16:07:27,972 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_604723262076837153 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:27,973 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_r_000000_0'
2013-10-31 16:07:27,973 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_604723262076837153 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:27,974 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000002_0'
2013-10-31 16:07:27,974 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000003_0'
2013-10-31 16:07:27,975 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_r_000000_0' has completed task_20131031160444934_0006_r_000000 successfully.
2013-10-31 16:07:27,977 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0005_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:27,981 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0006_m_000005_0' to tip task_20131031160444934_0006_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:07:27,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005	dst=null	perm=null
2013-10-31 16:07:27,982 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000004_0'
2013-10-31 16:07:27,986 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:07:27,986 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000005_0 which needs 1 slots
2013-10-31 16:07:27,987 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_m_000005_0 which needs 1 slots
2013-10-31 16:07:28,019 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0006/attempt_20131031160444934_0006_m_000005_0. Attempting to reuse: jvm_20131031160444934_0006_m_80173135
2013-10-31 16:07:28,301 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0005
2013-10-31 16:07:28,302 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0005 being deleted.
2013-10-31 16:07:29,451 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_80173135 given task: attempt_20131031160444934_0006_m_000005_0
2013-10-31 16:07:29,587 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000005_0 0.0% 
2013-10-31 16:07:29,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary	dst=null	perm=null
2013-10-31 16:07:29,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:29,605 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_SUCCESS from client DFSClient_attempt_20131031160444934_0006_m_000005_0
2013-10-31 16:07:29,606 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0006_m_000005_0
2013-10-31 16:07:29,611 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6795492832038410935 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:29,611 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6795492832038410935 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:29,612 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6795492832038410935 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:29,612 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6795492832038410935 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:29,612 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5739859526044531261 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:29,612 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5739859526044531261 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:29,612 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5739859526044531261 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:29,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5739859526044531261 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:29,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5582207694431061275 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:29,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5582207694431061275 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:29,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5582207694431061275 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:29,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5721256196737463602 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:29,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5721256196737463602 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:29,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5721256196737463602 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:29,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006	dst=null	perm=null
2013-10-31 16:07:29,677 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8532132085552426957_1057 file build/test/data/dfs/data/data1/current/blk_-8532132085552426957 for deletion
2013-10-31 16:07:29,678 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6361285198433998341_1060 file build/test/data/dfs/data/data2/current/blk_-6361285198433998341 for deletion
2013-10-31 16:07:29,678 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3866472487802171399_1064 file build/test/data/dfs/data/data2/current/blk_3866472487802171399 for deletion
2013-10-31 16:07:29,678 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4742838560224575816_1062 file build/test/data/dfs/data/data2/current/blk_4742838560224575816 for deletion
2013-10-31 16:07:29,678 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6361285198433998341_1060 at file build/test/data/dfs/data/data2/current/blk_-6361285198433998341
2013-10-31 16:07:29,678 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8532132085552426957_1057 at file build/test/data/dfs/data/data1/current/blk_-8532132085552426957
2013-10-31 16:07:29,678 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3866472487802171399_1064 at file build/test/data/dfs/data/data2/current/blk_3866472487802171399
2013-10-31 16:07:29,679 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4742838560224575816_1062 at file build/test/data/dfs/data/data2/current/blk_4742838560224575816
2013-10-31 16:07:29,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8532132085552426957_1057 file build/test/data/dfs/data/data8/current/blk_-8532132085552426957 for deletion
2013-10-31 16:07:29,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6361285198433998341_1060 file build/test/data/dfs/data/data7/current/blk_-6361285198433998341 for deletion
2013-10-31 16:07:29,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8532132085552426957_1057 at file build/test/data/dfs/data/data8/current/blk_-8532132085552426957
2013-10-31 16:07:29,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6361285198433998341_1060 at file build/test/data/dfs/data/data7/current/blk_-6361285198433998341
2013-10-31 16:07:29,880 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3866472487802171399_1064 file build/test/data/dfs/data/data7/current/blk_3866472487802171399 for deletion
2013-10-31 16:07:29,881 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4742838560224575816_1062 file build/test/data/dfs/data/data7/current/blk_4742838560224575816 for deletion
2013-10-31 16:07:29,881 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3866472487802171399_1064 at file build/test/data/dfs/data/data7/current/blk_3866472487802171399
2013-10-31 16:07:29,882 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4742838560224575816_1062 at file build/test/data/dfs/data/data7/current/blk_4742838560224575816
2013-10-31 16:07:30,179 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_604723262076837153_1070 blk_6795492832038410935_1058 blk_5739859526044531261_1061
2013-10-31 16:07:30,179 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-5582207694431061275_1063 blk_-5721256196737463602_1064 blk_604723262076837153_1070 blk_6795492832038410935_1058 blk_5739859526044531261_1061
2013-10-31 16:07:30,278 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5721256196737463602_1064 file build/test/data/dfs/data/data4/current/blk_-5721256196737463602 for deletion
2013-10-31 16:07:30,278 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5582207694431061275_1063 file build/test/data/dfs/data/data3/current/blk_-5582207694431061275 for deletion
2013-10-31 16:07:30,278 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5721256196737463602_1064 at file build/test/data/dfs/data/data4/current/blk_-5721256196737463602
2013-10-31 16:07:30,279 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_604723262076837153_1070 file build/test/data/dfs/data/data3/current/blk_604723262076837153 for deletion
2013-10-31 16:07:30,279 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5582207694431061275_1063 at file build/test/data/dfs/data/data3/current/blk_-5582207694431061275
2013-10-31 16:07:30,279 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5739859526044531261_1061 file build/test/data/dfs/data/data3/current/blk_5739859526044531261 for deletion
2013-10-31 16:07:30,279 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_604723262076837153_1070 at file build/test/data/dfs/data/data3/current/blk_604723262076837153
2013-10-31 16:07:30,280 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6795492832038410935_1058 file build/test/data/dfs/data/data3/current/blk_6795492832038410935 for deletion
2013-10-31 16:07:30,280 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5739859526044531261_1061 at file build/test/data/dfs/data/data3/current/blk_5739859526044531261
2013-10-31 16:07:30,280 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6795492832038410935_1058 at file build/test/data/dfs/data/data3/current/blk_6795492832038410935
2013-10-31 16:07:30,891 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_604723262076837153_1070 file build/test/data/dfs/data/data6/current/blk_604723262076837153 for deletion
2013-10-31 16:07:30,891 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5739859526044531261_1061 file build/test/data/dfs/data/data6/current/blk_5739859526044531261 for deletion
2013-10-31 16:07:30,891 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_604723262076837153_1070 at file build/test/data/dfs/data/data6/current/blk_604723262076837153
2013-10-31 16:07:30,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6795492832038410935_1058 file build/test/data/dfs/data/data6/current/blk_6795492832038410935 for deletion
2013-10-31 16:07:30,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5739859526044531261_1061 at file build/test/data/dfs/data/data6/current/blk_5739859526044531261
2013-10-31 16:07:30,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6795492832038410935_1058 at file build/test/data/dfs/data/data6/current/blk_6795492832038410935
2013-10-31 16:07:32,538 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000005_0 0.0% cleanup
2013-10-31 16:07:32,541 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000005_0 is done.
2013-10-31 16:07:32,541 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000005_0  was -1
2013-10-31 16:07:32,542 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:32,974 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0005
2013-10-31 16:07:32,974 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0005_m_000005_0 not found in cache
2013-10-31 16:07:32,975 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0005
2013-10-31 16:07:32,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0005 for user-log deletion with retainTimeStamp:1383322052975
2013-10-31 16:07:32,976 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0005 for user-log deletion with retainTimeStamp:1383322052976
2013-10-31 16:07:32,987 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:32,987 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:33,179 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-5582207694431061275_1063 blk_-5721256196737463602_1064 blk_604723262076837153_1070 blk_6795492832038410935_1058 blk_5739859526044531261_1061
2013-10-31 16:07:33,180 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5582207694431061275_1063 blk_-5721256196737463602_1064 blk_6795492832038410935_1058 blk_5739859526044531261_1061
2013-10-31 16:07:33,550 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_m_-921563826 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:33,560 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12795 with signal TERM. Exit code 0
2013-10-31 16:07:33,800 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_m_-919387719 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:33,807 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12831 with signal TERM. Exit code 0
2013-10-31 16:07:33,815 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:33,816 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:33,816 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:33,816 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-921563826 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:33,992 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000005_0' has completed task_20131031160444934_0006_m_000005 successfully.
2013-10-31 16:07:33,993 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0006 has completed successfully.
2013-10-31 16:07:33,994 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0006,submitTime=1383235615747,launchTime=1383235616296,firstMapTaskLaunchTime=1383235623507,firstReduceTaskLaunchTime=1383235629520,firstJobSetupTaskLaunchTime=1383235617324,firstJobCleanupTaskLaunchTime=1383235647981,finishTime=1383235653993,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=16,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2CC911EB25C3440AB1D0D1C97C8C5190/D4DBD78318DD492EAD89E9C4866521C6] lower*upper/(2/3)
2013-10-31 16:07:34,000 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E. blk_2659110045914674593_1074
2013-10-31 16:07:34,002 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2659110045914674593_1074 src: /127.0.0.1:54220 dest: /127.0.0.1:41648
2013-10-31 16:07:34,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2659110045914674593_1074 src: /127.0.0.1:47218 dest: /127.0.0.1:47311
2013-10-31 16:07:34,005 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2659110045914674593_1074 src: /127.0.0.1:34117 dest: /127.0.0.1:50942
2013-10-31 16:07:34,007 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34117, dest: /127.0.0.1:50942, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2659110045914674593_1074, duration: 242023
2013-10-31 16:07:34,008 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2659110045914674593_1074 terminating
2013-10-31 16:07:34,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47218, dest: /127.0.0.1:47311, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2659110045914674593_1074, duration: 1064460
2013-10-31 16:07:34,008 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2659110045914674593_1074 terminating
2013-10-31 16:07:34,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54220, dest: /127.0.0.1:41648, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2659110045914674593_1074, duration: 1450552
2013-10-31 16:07:34,009 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2659110045914674593_1074 terminating
2013-10-31 16:07:34,011 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2659110045914674593_1074 size 31965
2013-10-31 16:07:34,011 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E from client DFSClient_898051513
2013-10-31 16:07:34,011 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E is closed by DFSClient_898051513
2013-10-31 16:07:34,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2659110045914674593_1074 size 31965
2013-10-31 16:07:34,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2659110045914674593_1074 size 31965
2013-10-31 16:07:34,017 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000000_0'
2013-10-31 16:07:34,017 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:34,017 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000005_0'
2013-10-31 16:07:34,018 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1639395190201929201 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:34,018 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_r_000000_0'
2013-10-31 16:07:34,018 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1639395190201929201 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:34,019 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1639395190201929201 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:34,021 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (3/3) ...dpipesplatform/afterevery
2013-10-31 16:07:34,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006	dst=null	perm=null
2013-10-31 16:07:34,023 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0006_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:34,027 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:07:34,027 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:07:34,048 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:34,048 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:34,048 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:34,048 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-919387719 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:34,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:34,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:07:34,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,182 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar. blk_8838228819783861941_1075
2013-10-31 16:07:34,184 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838228819783861941_1075 src: /127.0.0.1:34118 dest: /127.0.0.1:50942
2013-10-31 16:07:34,186 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838228819783861941_1075 src: /127.0.0.1:34188 dest: /127.0.0.1:38271
2013-10-31 16:07:34,187 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838228819783861941_1075 src: /127.0.0.1:54225 dest: /127.0.0.1:41648
2013-10-31 16:07:34,195 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54225, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8838228819783861941_1075, duration: 3755733
2013-10-31 16:07:34,195 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8838228819783861941_1075 terminating
2013-10-31 16:07:34,195 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34188, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8838228819783861941_1075, duration: 4571118
2013-10-31 16:07:34,196 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8838228819783861941_1075 terminating
2013-10-31 16:07:34,196 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34118, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8838228819783861941_1075, duration: 5952677
2013-10-31 16:07:34,197 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8838228819783861941_1075 terminating
2013-10-31 16:07:34,199 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_m_527717294 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:34,199 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8838228819783861941_1075 size 238055
2013-10-31 16:07:34,201 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar from client DFSClient_1457307213
2013-10-31 16:07:34,201 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar is closed by DFSClient_1457307213
2013-10-31 16:07:34,202 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8838228819783861941_1075 size 238055
2013-10-31 16:07:34,202 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8838228819783861941_1075 size 238055
2013-10-31 16:07:34,207 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar. New replication is 10
2013-10-31 16:07:34,210 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13558 with signal TERM. Exit code 0
2013-10-31 16:07:34,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar	dst=null	perm=null
2013-10-31 16:07:34,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,219 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:07:34,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997	dst=null	perm=null
2013-10-31 16:07:34,226 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:34,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/part-00000	dst=null	perm=null
2013-10-31 16:07:34,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,248 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split. New replication is 10
2013-10-31 16:07:34,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split	dst=null	perm=null
2013-10-31 16:07:34,254 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split. blk_2028997783111402336_1076
2013-10-31 16:07:34,255 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2028997783111402336_1076 src: /127.0.0.1:34121 dest: /127.0.0.1:50942
2013-10-31 16:07:34,255 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2028997783111402336_1076 src: /127.0.0.1:34191 dest: /127.0.0.1:38271
2013-10-31 16:07:34,256 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2028997783111402336_1076 src: /127.0.0.1:54228 dest: /127.0.0.1:41648
2013-10-31 16:07:34,257 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2028997783111402336_1076 src: /127.0.0.1:47226 dest: /127.0.0.1:47311
2013-10-31 16:07:34,258 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47226, dest: /127.0.0.1:47311, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2028997783111402336_1076, duration: 30213
2013-10-31 16:07:34,258 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2028997783111402336_1076 terminating
2013-10-31 16:07:34,258 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54228, dest: /127.0.0.1:41648, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2028997783111402336_1076, duration: 348137
2013-10-31 16:07:34,258 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2028997783111402336_1076 terminating
2013-10-31 16:07:34,259 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34191, dest: /127.0.0.1:38271, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2028997783111402336_1076, duration: 697394
2013-10-31 16:07:34,259 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2028997783111402336_1076 terminating
2013-10-31 16:07:34,259 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34121, dest: /127.0.0.1:50942, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2028997783111402336_1076, duration: 1179930
2013-10-31 16:07:34,259 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2028997783111402336_1076 terminating
2013-10-31 16:07:34,261 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2028997783111402336_1076 size 352
2013-10-31 16:07:34,262 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split from client DFSClient_1457307213
2013-10-31 16:07:34,262 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split is closed by DFSClient_1457307213
2013-10-31 16:07:34,262 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2028997783111402336_1076 size 352
2013-10-31 16:07:34,262 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2028997783111402336_1076 size 352
2013-10-31 16:07:34,262 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2028997783111402336_1076 size 352
2013-10-31 16:07:34,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,280 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo. blk_-4067490714316058154_1077
2013-10-31 16:07:34,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4067490714316058154_1077 src: /127.0.0.1:47227 dest: /127.0.0.1:47311
2013-10-31 16:07:34,282 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4067490714316058154_1077 src: /127.0.0.1:34126 dest: /127.0.0.1:50942
2013-10-31 16:07:34,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4067490714316058154_1077 src: /127.0.0.1:34196 dest: /127.0.0.1:38271
2013-10-31 16:07:34,285 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34196, dest: /127.0.0.1:38271, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4067490714316058154_1077, duration: 40582
2013-10-31 16:07:34,285 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4067490714316058154_1077 terminating
2013-10-31 16:07:34,285 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4067490714316058154_1077 size 44
2013-10-31 16:07:34,285 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34126, dest: /127.0.0.1:50942, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4067490714316058154_1077, duration: 1438654
2013-10-31 16:07:34,286 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4067490714316058154_1077 terminating
2013-10-31 16:07:34,286 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47227, dest: /127.0.0.1:47311, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4067490714316058154_1077, duration: 1955271
2013-10-31 16:07:34,286 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4067490714316058154_1077 terminating
2013-10-31 16:07:34,287 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:07:34,287 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:07:34,288 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4067490714316058154_1077 size 44
2013-10-31 16:07:34,289 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4067490714316058154_1077 size 44
2013-10-31 16:07:34,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,306 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000001_0'
2013-10-31 16:07:34,306 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml. blk_4137129478089268586_1078
2013-10-31 16:07:34,306 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000002_0'
2013-10-31 16:07:34,308 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4137129478089268586_1078 src: /127.0.0.1:47230 dest: /127.0.0.1:47311
2013-10-31 16:07:34,309 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4137129478089268586_1078 src: /127.0.0.1:34129 dest: /127.0.0.1:50942
2013-10-31 16:07:34,310 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4137129478089268586_1078 src: /127.0.0.1:54235 dest: /127.0.0.1:41648
2013-10-31 16:07:34,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54235, dest: /127.0.0.1:41648, bytes: 28800, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4137129478089268586_1078, duration: 1033929
2013-10-31 16:07:34,313 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4137129478089268586_1078 terminating
2013-10-31 16:07:34,313 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4137129478089268586_1078 size 28800
2013-10-31 16:07:34,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34129, dest: /127.0.0.1:50942, bytes: 28800, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4137129478089268586_1078, duration: 612898
2013-10-31 16:07:34,314 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4137129478089268586_1078 terminating
2013-10-31 16:07:34,314 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47230, dest: /127.0.0.1:47311, bytes: 28800, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4137129478089268586_1078, duration: 1660751
2013-10-31 16:07:34,315 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4137129478089268586_1078 terminating
2013-10-31 16:07:34,316 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4137129478089268586_1078 size 28800
2013-10-31 16:07:34,316 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml from client DFSClient_1457307213
2013-10-31 16:07:34,317 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml is closed by DFSClient_1457307213
2013-10-31 16:07:34,317 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4137129478089268586_1078 size 28800
2013-10-31 16:07:34,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml	dst=null	perm=null
2013-10-31 16:07:34,327 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_r_1565160902 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:34,331 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34132, bytes: 29028, op: HDFS_READ, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4137129478089268586_1078, duration: 494467
2013-10-31 16:07:34,335 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13198 with signal TERM. Exit code 0
2013-10-31 16:07:34,351 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0007: nMaps=1 nReduces=0 max=-1
2013-10-31 16:07:34,351 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0007 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:07:34,351 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0007
2013-10-31 16:07:34,351 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0007	RESULT=SUCCESS
2013-10-31 16:07:34,351 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0007
2013-10-31 16:07:34,352 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0007
2013-10-31 16:07:34,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,383 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:34,383 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:34,383 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:34,383 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_527717294 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:34,502 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:34,502 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:34,502 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:34,502 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_r_1565160902 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:34,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,861 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_conf.xml. blk_6838092899154676359_1080
2013-10-31 16:07:34,863 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6838092899154676359_1080 src: /127.0.0.1:54238 dest: /127.0.0.1:41648
2013-10-31 16:07:34,865 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6838092899154676359_1080 src: /127.0.0.1:47236 dest: /127.0.0.1:47311
2013-10-31 16:07:34,866 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6838092899154676359_1080 src: /127.0.0.1:34204 dest: /127.0.0.1:38271
2013-10-31 16:07:34,871 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34204, dest: /127.0.0.1:38271, bytes: 28865, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6838092899154676359_1080, duration: 713421
2013-10-31 16:07:34,871 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6838092899154676359_1080 terminating
2013-10-31 16:07:34,872 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47236, dest: /127.0.0.1:47311, bytes: 28865, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6838092899154676359_1080, duration: 1489019
2013-10-31 16:07:34,872 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6838092899154676359_1080 terminating
2013-10-31 16:07:34,873 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54238, dest: /127.0.0.1:41648, bytes: 28865, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6838092899154676359_1080, duration: 2508359
2013-10-31 16:07:34,873 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6838092899154676359_1080 terminating
2013-10-31 16:07:34,873 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6838092899154676359_1080 size 28865
2013-10-31 16:07:34,879 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_conf.xml from client DFSClient_1197825700
2013-10-31 16:07:34,879 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_conf.xml is closed by DFSClient_1197825700
2013-10-31 16:07:34,880 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6838092899154676359_1080 size 28865
2013-10-31 16:07:34,880 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6838092899154676359_1080 size 28865
2013-10-31 16:07:34,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,894 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken. blk_-8749881692688222416_1081
2013-10-31 16:07:34,896 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8749881692688222416_1081 src: /127.0.0.1:34136 dest: /127.0.0.1:50942
2013-10-31 16:07:34,898 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8749881692688222416_1081 src: /127.0.0.1:34206 dest: /127.0.0.1:38271
2013-10-31 16:07:34,899 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8749881692688222416_1081 src: /127.0.0.1:47240 dest: /127.0.0.1:47311
2013-10-31 16:07:34,902 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47240, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8749881692688222416_1081, duration: 65109
2013-10-31 16:07:34,903 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8749881692688222416_1081 terminating
2013-10-31 16:07:34,903 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34206, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8749881692688222416_1081, duration: 928181
2013-10-31 16:07:34,904 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8749881692688222416_1081 terminating
2013-10-31 16:07:34,904 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8749881692688222416_1081 size 116
2013-10-31 16:07:34,904 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34136, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8749881692688222416_1081, duration: 1747348
2013-10-31 16:07:34,905 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8749881692688222416_1081 terminating
2013-10-31 16:07:34,907 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8749881692688222416_1081 size 116
2013-10-31 16:07:34,907 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken from client DFSClient_1457307213
2013-10-31 16:07:34,908 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken is closed by DFSClient_1457307213
2013-10-31 16:07:34,908 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8749881692688222416_1081 size 116
2013-10-31 16:07:34,913 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken
2013-10-31 16:07:34,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:07:34,918 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47241, bytes: 48, op: HDFS_READ, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4067490714316058154_1077, duration: 281578
2013-10-31 16:07:34,918 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0007 = 180. Number of splits = 1
2013-10-31 16:07:34,918 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:34,919 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:34,919 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:34,919 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0007 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:07:34,920 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0007 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 16:07:35,680 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5721256196737463602_1064 file build/test/data/dfs/data/data1/current/blk_-5721256196737463602 for deletion
2013-10-31 16:07:35,680 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5582207694431061275_1063 file build/test/data/dfs/data/data1/current/blk_-5582207694431061275 for deletion
2013-10-31 16:07:35,681 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5739859526044531261_1061 file build/test/data/dfs/data/data1/current/blk_5739859526044531261 for deletion
2013-10-31 16:07:35,681 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6795492832038410935_1058 file build/test/data/dfs/data/data2/current/blk_6795492832038410935 for deletion
2013-10-31 16:07:35,882 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5721256196737463602_1064 file build/test/data/dfs/data/data8/current/blk_-5721256196737463602 for deletion
2013-10-31 16:07:35,882 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5582207694431061275_1063 file build/test/data/dfs/data/data8/current/blk_-5582207694431061275 for deletion
2013-10-31 16:07:35,882 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_604723262076837153_1070 file build/test/data/dfs/data/data8/current/blk_604723262076837153 for deletion
2013-10-31 16:07:35,883 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5739859526044531261_1061 file build/test/data/dfs/data/data8/current/blk_5739859526044531261 for deletion
2013-10-31 16:07:35,883 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6795492832038410935_1058 file build/test/data/dfs/data/data8/current/blk_6795492832038410935 for deletion
2013-10-31 16:07:36,176 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5721256196737463602_1064 at file build/test/data/dfs/data/data1/current/blk_-5721256196737463602
2013-10-31 16:07:36,176 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6795492832038410935_1058 at file build/test/data/dfs/data/data2/current/blk_6795492832038410935
2013-10-31 16:07:36,176 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5582207694431061275_1063 at file build/test/data/dfs/data/data1/current/blk_-5582207694431061275
2013-10-31 16:07:36,176 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5721256196737463602_1064 at file build/test/data/dfs/data/data8/current/blk_-5721256196737463602
2013-10-31 16:07:36,176 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5739859526044531261_1061 at file build/test/data/dfs/data/data1/current/blk_5739859526044531261
2013-10-31 16:07:36,177 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5582207694431061275_1063 at file build/test/data/dfs/data/data8/current/blk_-5582207694431061275
2013-10-31 16:07:36,177 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_604723262076837153_1070 at file build/test/data/dfs/data/data8/current/blk_604723262076837153
2013-10-31 16:07:36,177 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5739859526044531261_1061 at file build/test/data/dfs/data/data8/current/blk_5739859526044531261
2013-10-31 16:07:36,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6795492832038410935_1058 at file build/test/data/dfs/data/data8/current/blk_6795492832038410935
2013-10-31 16:07:36,180 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_8838228819783861941_1075 to datanode(s) 127.0.0.1:47311
2013-10-31 16:07:36,181 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_1639395190201929201_1070
2013-10-31 16:07:36,181 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_1639395190201929201_1070
2013-10-31 16:07:36,893 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_8838228819783861941_1075 to 127.0.0.1:47311 
2013-10-31 16:07:36,894 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1639395190201929201_1070 file build/test/data/dfs/data/data5/current/blk_1639395190201929201 for deletion
2013-10-31 16:07:36,894 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1639395190201929201_1070 at file build/test/data/dfs/data/data5/current/blk_1639395190201929201
2013-10-31 16:07:36,896 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838228819783861941_1075 src: /127.0.0.1:47242 dest: /127.0.0.1:47311
2013-10-31 16:07:36,896 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_8838228819783861941_1075 to /127.0.0.1:47311
2013-10-31 16:07:36,900 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_8838228819783861941_1075 src: /127.0.0.1:47242 dest: /127.0.0.1:47311 of size 238055
2013-10-31 16:07:36,904 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8838228819783861941_1075 size 238055
2013-10-31 16:07:36,983 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0007_m_000002_0' to tip task_20131031160444934_0007_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:36,987 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000003_0'
2013-10-31 16:07:36,987 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000004_0'
2013-10-31 16:07:36,992 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0007_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:07:36,992 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000006_0'
2013-10-31 16:07:36,992 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0007_m_000002_0 which needs 1 slots
2013-10-31 16:07:36,993 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0007_m_000002_0 which needs 1 slots
2013-10-31 16:07:36,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken	dst=null	perm=null
2013-10-31 16:07:37,002 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47243, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8749881692688222416_1081, duration: 303176
2013-10-31 16:07:37,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml	dst=null	perm=null
2013-10-31 16:07:37,013 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54248, bytes: 29028, op: HDFS_READ, cliID: DFSClient_2143540042, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4137129478089268586_1078, duration: 388549
2013-10-31 16:07:37,043 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:37,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar	dst=null	perm=null
2013-10-31 16:07:37,077 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34213, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2143540042, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8838228819783861941_1075, duration: 1633651
2013-10-31 16:07:37,178 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0007_m_-1232237882
2013-10-31 16:07:37,179 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0007_m_-1232237882 spawned.
2013-10-31 16:07:37,180 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0007/attempt_20131031160444934_0007_m_000002_0/taskjvm.sh
2013-10-31 16:07:37,987 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0005
2013-10-31 16:07:37,989 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0005 for user-log deletion with retainTimeStamp:1383322057988
2013-10-31 16:07:38,307 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_m_-406446409 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:38,313 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12833 with signal TERM. Exit code 0
2013-10-31 16:07:38,525 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:38,525 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:38,525 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:38,525 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-406446409 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:38,545 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0007_m_-1232237882 given task: attempt_20131031160444934_0007_m_000002_0
2013-10-31 16:07:38,882 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1639395190201929201_1070 file build/test/data/dfs/data/data7/current/blk_1639395190201929201 for deletion
2013-10-31 16:07:38,883 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1639395190201929201_1070 at file build/test/data/dfs/data/data7/current/blk_1639395190201929201
2013-10-31 16:07:39,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:39,182 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_1639395190201929201_1070
2013-10-31 16:07:39,307 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0006
2013-10-31 16:07:39,308 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0006 for user-log deletion with retainTimeStamp:1383322059308
2013-10-31 16:07:39,822 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_m_-1130629699 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:39,832 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12830 with signal TERM. Exit code 0
2013-10-31 16:07:39,854 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:07:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,876 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,881 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,887 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,892 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,899 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_m_-245324502 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:39,901 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,901 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:07:39,907 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12832 with signal TERM. Exit code 0
2013-10-31 16:07:40,042 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:40,042 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:40,042 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:40,042 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_-1130629699 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:40,091 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:40,091 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:40,091 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:40,091 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_-245324502 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:41,682 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1639395190201929201_1070 file build/test/data/dfs/data/data1/current/blk_1639395190201929201 for deletion
2013-10-31 16:07:41,682 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1639395190201929201_1070 at file build/test/data/dfs/data/data1/current/blk_1639395190201929201
2013-10-31 16:07:41,969 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000002_0 0.0% setup
2013-10-31 16:07:41,972 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0007_m_000002_0 is done.
2013-10-31 16:07:41,972 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0007_m_000002_0  was -1
2013-10-31 16:07:41,973 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:41,992 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0006
2013-10-31 16:07:41,993 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0006 for user-log deletion with retainTimeStamp:1383322061993
2013-10-31 16:07:41,993 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0006
2013-10-31 16:07:41,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0006 for user-log deletion with retainTimeStamp:1383322061994
2013-10-31 16:07:42,989 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0006
2013-10-31 16:07:42,990 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0006_m_000005_0 not found in cache
2013-10-31 16:07:42,991 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0006 for user-log deletion with retainTimeStamp:1383322062990
2013-10-31 16:07:42,995 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0007_m_000002_0' has completed task_20131031160444934_0007_m_000002 successfully.
2013-10-31 16:07:42,998 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0007_m_000000_0' to tip task_20131031160444934_0007_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:42,999 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0007_m_000000
2013-10-31 16:07:43,002 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0007_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:43,002 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0007_m_000000_0 which needs 1 slots
2013-10-31 16:07:43,002 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0007_m_000000_0 which needs 1 slots
2013-10-31 16:07:43,038 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0007/attempt_20131031160444934_0007_m_000000_0. Attempting to reuse: jvm_20131031160444934_0007_m_-1232237882
2013-10-31 16:07:43,321 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_r_-541739399 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:43,330 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13242 with signal TERM. Exit code 0
2013-10-31 16:07:43,403 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_m_1282739064 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:43,408 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13317 with signal TERM. Exit code 0
2013-10-31 16:07:43,506 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:43,506 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:43,506 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:43,506 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_r_-541739399 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:43,526 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0007_m_-1232237882 given task: attempt_20131031160444934_0007_m_000000_0
2013-10-31 16:07:43,585 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_m_80173135 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:43,590 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12835 with signal TERM. Exit code 0
2013-10-31 16:07:43,604 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:43,604 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:43,604 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:43,605 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_1282739064 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:43,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split	dst=null	perm=null
2013-10-31 16:07:43,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34148, bytes: 356, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2028997783111402336_1076, duration: 126020
2013-10-31 16:07:43,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/part-00000	dst=null	perm=null
2013-10-31 16:07:43,668 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34218, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2693516798230755184_1072, duration: 108361
2013-10-31 16:07:43,692 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 441 Total time for transactions(ms): 10Number of transactions batched in Syncs: 41 Number of syncs: 308 SyncTimes(ms): 11315 1492 
2013-10-31 16:07:43,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:43,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:43,748 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:43,748 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:43,748 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:07:43,748 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_80173135 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:07:43,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6	dst=null	perm=null
2013-10-31 16:07:43,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/part-00000	dst=null	perm=null
2013-10-31 16:07:43,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/part-00000	dst=null	perm=null
2013-10-31 16:07:43,952 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47252, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2997245466678193792_1071, duration: 275806
2013-10-31 16:07:43,964 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000. blk_-8015266309344838465_1082
2013-10-31 16:07:43,978 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8015266309344838465_1082 src: /127.0.0.1:34220 dest: /127.0.0.1:38271
2013-10-31 16:07:43,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8015266309344838465_1082 src: /127.0.0.1:34152 dest: /127.0.0.1:50942
2013-10-31 16:07:43,981 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8015266309344838465_1082 src: /127.0.0.1:54258 dest: /127.0.0.1:41648
2013-10-31 16:07:43,983 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54258, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8015266309344838465_1082, duration: 1820721
2013-10-31 16:07:43,984 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8015266309344838465_1082 terminating
2013-10-31 16:07:43,984 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34152, dest: /127.0.0.1:50942, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8015266309344838465_1082, duration: 2186684
2013-10-31 16:07:43,984 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8015266309344838465_1082 terminating
2013-10-31 16:07:43,984 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8015266309344838465_1082 size 40
2013-10-31 16:07:43,984 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34220, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8015266309344838465_1082, duration: 2325259
2013-10-31 16:07:43,985 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8015266309344838465_1082 terminating
2013-10-31 16:07:43,985 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8015266309344838465_1082 size 40
2013-10-31 16:07:43,988 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8015266309344838465_1082 size 40
2013-10-31 16:07:43,988 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0007_m_000000_0
2013-10-31 16:07:43,988 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0007_m_000000_0
2013-10-31 16:07:44,032 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0007_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:07:44,032 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000000_0 0.0% 
2013-10-31 16:07:46,006 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0007_m_000000_0
2013-10-31 16:07:46,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0	dst=null	perm=null
2013-10-31 16:07:46,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:46,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:46,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0	dst=null	perm=null
2013-10-31 16:07:46,593 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000000_0 1.0% hdfs://localhost:43856/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/part-00000:0+180
2013-10-31 16:07:46,595 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0007_m_000000_0 is done.
2013-10-31 16:07:46,595 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0007_m_000000_0  was -1
2013-10-31 16:07:46,595 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:48,002 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0007_m_000002_0
2013-10-31 16:07:48,003 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0007_m_000002_0
2013-10-31 16:07:48,003 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0007_m_000002_0 not found in cache
2013-10-31 16:07:49,010 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0007_m_000000_0' has completed task_20131031160444934_0007_m_000000 successfully.
2013-10-31 16:07:49,013 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0007_m_000001_0' to tip task_20131031160444934_0007_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:49,016 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0007_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:07:49,016 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0007_m_000001_0 which needs 1 slots
2013-10-31 16:07:49,016 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0007_m_000001_0 which needs 1 slots
2013-10-31 16:07:49,054 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0007_m_-769706857
2013-10-31 16:07:49,055 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0007_m_-769706857 spawned.
2013-10-31 16:07:49,058 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0007/attempt_20131031160444934_0007_m_000001_0/taskjvm.sh
2013-10-31 16:07:49,896 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0007_m_-769706857 given task: attempt_20131031160444934_0007_m_000001_0
2013-10-31 16:07:50,399 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000001_0 0.0% 
2013-10-31 16:07:50,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary	dst=null	perm=null
2013-10-31 16:07:50,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:50,425 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_SUCCESS from client DFSClient_attempt_20131031160444934_0007_m_000001_0
2013-10-31 16:07:50,425 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0007_m_000001_0
2013-10-31 16:07:50,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8838228819783861941 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:50,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8838228819783861941 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:50,434 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8838228819783861941 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:50,434 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8838228819783861941 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:50,434 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2028997783111402336 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:50,434 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2028997783111402336 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:50,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2028997783111402336 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:50,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2028997783111402336 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:50,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4067490714316058154 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:50,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4067490714316058154 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:50,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4067490714316058154 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:50,436 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4137129478089268586 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:50,436 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4137129478089268586 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:50,436 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4137129478089268586 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:50,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007	dst=null	perm=null
2013-10-31 16:07:51,184 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_2028997783111402336_1076 blk_-4067490714316058154_1077 blk_8838228819783861941_1075 blk_4137129478089268586_1078
2013-10-31 16:07:51,185 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_2028997783111402336_1076 blk_-4067490714316058154_1077 blk_8838228819783861941_1075 blk_4137129478089268586_1078
2013-10-31 16:07:51,285 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4067490714316058154_1077 file build/test/data/dfs/data/data4/current/blk_-4067490714316058154 for deletion
2013-10-31 16:07:51,285 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2028997783111402336_1076 file build/test/data/dfs/data/data3/current/blk_2028997783111402336 for deletion
2013-10-31 16:07:51,285 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4067490714316058154_1077 at file build/test/data/dfs/data/data4/current/blk_-4067490714316058154
2013-10-31 16:07:51,286 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4137129478089268586_1078 file build/test/data/dfs/data/data3/current/blk_4137129478089268586 for deletion
2013-10-31 16:07:51,286 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2028997783111402336_1076 at file build/test/data/dfs/data/data3/current/blk_2028997783111402336
2013-10-31 16:07:51,286 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8838228819783861941_1075 file build/test/data/dfs/data/data4/current/blk_8838228819783861941 for deletion
2013-10-31 16:07:51,286 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4137129478089268586_1078 at file build/test/data/dfs/data/data3/current/blk_4137129478089268586
2013-10-31 16:07:51,287 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8838228819783861941_1075 at file build/test/data/dfs/data/data4/current/blk_8838228819783861941
2013-10-31 16:07:53,334 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000001_0 0.0% cleanup
2013-10-31 16:07:53,335 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0007_m_000001_0 is done.
2013-10-31 16:07:53,336 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0007_m_000001_0  was -1
2013-10-31 16:07:53,336 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:53,888 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4067490714316058154_1077 file build/test/data/dfs/data/data8/current/blk_-4067490714316058154 for deletion
2013-10-31 16:07:53,888 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2028997783111402336_1076 file build/test/data/dfs/data/data7/current/blk_2028997783111402336 for deletion
2013-10-31 16:07:53,888 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4067490714316058154_1077 at file build/test/data/dfs/data/data8/current/blk_-4067490714316058154
2013-10-31 16:07:53,888 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4137129478089268586_1078 file build/test/data/dfs/data/data7/current/blk_4137129478089268586 for deletion
2013-10-31 16:07:53,889 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2028997783111402336_1076 at file build/test/data/dfs/data/data7/current/blk_2028997783111402336
2013-10-31 16:07:53,889 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8838228819783861941_1075 file build/test/data/dfs/data/data8/current/blk_8838228819783861941 for deletion
2013-10-31 16:07:53,889 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4137129478089268586_1078 at file build/test/data/dfs/data/data7/current/blk_4137129478089268586
2013-10-31 16:07:53,890 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8838228819783861941_1075 at file build/test/data/dfs/data/data8/current/blk_8838228819783861941
2013-10-31 16:07:54,185 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_2028997783111402336_1076 blk_8838228819783861941_1075 blk_4137129478089268586_1078
2013-10-31 16:07:54,186 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_2028997783111402336_1076 blk_-4067490714316058154_1077 blk_8838228819783861941_1075
2013-10-31 16:07:54,899 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2028997783111402336_1076 file build/test/data/dfs/data/data5/current/blk_2028997783111402336 for deletion
2013-10-31 16:07:54,899 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4137129478089268586_1078 file build/test/data/dfs/data/data6/current/blk_4137129478089268586 for deletion
2013-10-31 16:07:54,899 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2028997783111402336_1076 at file build/test/data/dfs/data/data5/current/blk_2028997783111402336
2013-10-31 16:07:54,899 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8838228819783861941_1075 file build/test/data/dfs/data/data6/current/blk_8838228819783861941 for deletion
2013-10-31 16:07:54,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4137129478089268586_1078 at file build/test/data/dfs/data/data6/current/blk_4137129478089268586
2013-10-31 16:07:54,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8838228819783861941_1075 at file build/test/data/dfs/data/data6/current/blk_8838228819783861941
2013-10-31 16:07:55,007 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 16
2013-10-31 16:07:55,026 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0007_m_000001_0' has completed task_20131031160444934_0007_m_000001 successfully.
2013-10-31 16:07:55,027 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0007 has completed successfully.
2013-10-31 16:07:55,027 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0007,submitTime=1383235654321,launchTime=1383235654919,firstMapTaskLaunchTime=1383235662998,firstJobSetupTaskLaunchTime=1383235656982,firstJobCleanupTaskLaunchTime=1383235669013,finishTime=1383235675027,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2CC911EB25C3440AB1D0D1C97C8C5190/25B9C49BB9564567ABBE62FC380614D8] lower*upper/(3/3) ...dpipesplatform/afterevery
2013-10-31 16:07:55,033 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567. blk_-3451961400852813586_1083
2013-10-31 16:07:55,036 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3451961400852813586_1083 src: /127.0.0.1:54263 dest: /127.0.0.1:41648
2013-10-31 16:07:55,039 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3451961400852813586_1083 src: /127.0.0.1:47261 dest: /127.0.0.1:47311
2013-10-31 16:07:55,041 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3451961400852813586_1083 src: /127.0.0.1:34229 dest: /127.0.0.1:38271
2013-10-31 16:07:55,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34229, dest: /127.0.0.1:38271, bytes: 11325, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3451961400852813586_1083, duration: 1752373
2013-10-31 16:07:55,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3451961400852813586_1083 terminating
2013-10-31 16:07:55,049 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47261, dest: /127.0.0.1:47311, bytes: 11325, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3451961400852813586_1083, duration: 5347831
2013-10-31 16:07:55,049 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3451961400852813586_1083 terminating
2013-10-31 16:07:55,050 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3451961400852813586_1083 size 11325
2013-10-31 16:07:55,050 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54263, dest: /127.0.0.1:41648, bytes: 11325, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3451961400852813586_1083, duration: 6188624
2013-10-31 16:07:55,050 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3451961400852813586_1083 terminating
2013-10-31 16:07:55,053 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567 from client DFSClient_1197825700
2013-10-31 16:07:55,055 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567 is closed by DFSClient_1197825700
2013-10-31 16:07:55,055 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3451961400852813586_1083 size 11325
2013-10-31 16:07:55,056 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3451961400852813586_1083 size 11325
2013-10-31 16:07:55,064 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:55,065 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0007_m_000000_0'
2013-10-31 16:07:55,065 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0007_m_000001_0'
2013-10-31 16:07:55,065 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0007_m_000002_0'
2013-10-31 16:07:55,066 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8749881692688222416 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:55,067 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8749881692688222416 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,067 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8749881692688222416 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,069 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0007_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:55,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007	dst=null	perm=null
2013-10-31 16:07:55,074 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119686764560670206 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,075 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119686764560670206 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:55,075 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119686764560670206 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,075 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7203448194588732562 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,075 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7203448194588732562 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,075 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7203448194588732562 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,076 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2997245466678193792 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,076 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2997245466678193792 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,076 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2997245466678193792 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6	dst=null	perm=null
2013-10-31 16:07:55,083 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2659110045914674593 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,083 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2659110045914674593 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,083 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2659110045914674593 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,083 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6149960951356387480 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,084 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6149960951356387480 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,084 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6149960951356387480 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:55,084 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2693516798230755184 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,084 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2693516798230755184 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,085 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2693516798230755184 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:55,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997	dst=null	perm=null
2013-10-31 16:07:55,092 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary
2013-10-31 16:07:55,103 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0007
2013-10-31 16:07:55,103 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0007 being deleted.
2013-10-31 16:07:55,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2013-10-31 16:07:55,113 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2013-10-31 16:07:55,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2013-10-31 16:07:55,117 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34162, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8015266309344838465_1082, duration: 295314
2013-10-31 16:07:55,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2013-10-31 16:07:55,125 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2013-10-31 16:07:55,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2013-10-31 16:07:55,129 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54268, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8015266309344838465_1082, duration: 277140
2013-10-31 16:07:55,129 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/afterevery
2013-10-31 16:07:55,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2013-10-31 16:07:55,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2013-10-31 16:07:55,135 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54269, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8015266309344838465_1082, duration: 270587
2013-10-31 16:07:55,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,146 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt. blk_4001027560673372033_1084
2013-10-31 16:07:55,147 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4001027560673372033_1084 src: /127.0.0.1:34234 dest: /127.0.0.1:38271
2013-10-31 16:07:55,148 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4001027560673372033_1084 src: /127.0.0.1:34166 dest: /127.0.0.1:50942
2013-10-31 16:07:55,150 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4001027560673372033_1084 src: /127.0.0.1:54272 dest: /127.0.0.1:41648
2013-10-31 16:07:55,152 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54272, dest: /127.0.0.1:41648, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 1047403
2013-10-31 16:07:55,152 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4001027560673372033_1084 terminating
2013-10-31 16:07:55,153 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34166, dest: /127.0.0.1:50942, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 1611473
2013-10-31 16:07:55,153 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4001027560673372033_1084 terminating
2013-10-31 16:07:55,154 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34234, dest: /127.0.0.1:38271, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 1919716
2013-10-31 16:07:55,154 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4001027560673372033_1084 terminating
2013-10-31 16:07:55,155 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4001027560673372033_1084 size 52
2013-10-31 16:07:55,157 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt from client DFSClient_1457307213
2013-10-31 16:07:55,158 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt is closed by DFSClient_1457307213
2013-10-31 16:07:55,158 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4001027560673372033_1084 size 52
2013-10-31 16:07:55,158 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4001027560673372033_1084 size 52
2013-10-31 16:07:55,331 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0007
2013-10-31 16:07:55,331 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0007 being deleted.
2013-10-31 16:07:55,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,391 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt. blk_-1539762991683523844_1085
2013-10-31 16:07:55,393 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1539762991683523844_1085 src: /127.0.0.1:34237 dest: /127.0.0.1:38271
2013-10-31 16:07:55,394 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1539762991683523844_1085 src: /127.0.0.1:54274 dest: /127.0.0.1:41648
2013-10-31 16:07:55,396 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1539762991683523844_1085 src: /127.0.0.1:47272 dest: /127.0.0.1:47311
2013-10-31 16:07:55,399 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47272, dest: /127.0.0.1:47311, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 67195
2013-10-31 16:07:55,399 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1539762991683523844_1085 terminating
2013-10-31 16:07:55,400 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54274, dest: /127.0.0.1:41648, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 825817
2013-10-31 16:07:55,400 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1539762991683523844_1085 terminating
2013-10-31 16:07:55,401 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34237, dest: /127.0.0.1:38271, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 1733537
2013-10-31 16:07:55,401 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1539762991683523844_1085 terminating
2013-10-31 16:07:55,404 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1539762991683523844_1085 size 51
2013-10-31 16:07:55,405 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt from client DFSClient_1457307213
2013-10-31 16:07:55,405 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt is closed by DFSClient_1457307213
2013-10-31 16:07:55,405 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1539762991683523844_1085 size 51
2013-10-31 16:07:55,406 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1539762991683523844_1085 size 51
2013-10-31 16:07:55,431 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:07:55,432 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:07:55,468 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting
2013-10-31 16:07:55,468 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:07:55,468 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:07:55,468 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:07:55,469 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:07:55,469 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin"]
2013-10-31 16:07:55,469 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  parallel execution is enabled: true
2013-10-31 16:07:55,469 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  starting jobs: 1
2013-10-31 16:07:55,469 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  allocating threads: 1
2013-10-31 16:07:55,470 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (1/1) ...intocogrouplhsswappedjoin
2013-10-31 16:07:55,474 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:07:55,474 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:07:55,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:55,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:07:55,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,496 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar. blk_5246180269824711248_1086
2013-10-31 16:07:55,497 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5246180269824711248_1086 src: /127.0.0.1:47273 dest: /127.0.0.1:47311
2013-10-31 16:07:55,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5246180269824711248_1086 src: /127.0.0.1:34241 dest: /127.0.0.1:38271
2013-10-31 16:07:55,500 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5246180269824711248_1086 src: /127.0.0.1:54278 dest: /127.0.0.1:41648
2013-10-31 16:07:55,510 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54278, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5246180269824711248_1086, duration: 6376895
2013-10-31 16:07:55,510 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5246180269824711248_1086 terminating
2013-10-31 16:07:55,511 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34241, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5246180269824711248_1086, duration: 6753377
2013-10-31 16:07:55,511 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5246180269824711248_1086 terminating
2013-10-31 16:07:55,512 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47273, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5246180269824711248_1086, duration: 7312496
2013-10-31 16:07:55,512 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5246180269824711248_1086 terminating
2013-10-31 16:07:55,515 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5246180269824711248_1086 size 238055
2013-10-31 16:07:55,515 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar from client DFSClient_1457307213
2013-10-31 16:07:55,515 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar is closed by DFSClient_1457307213
2013-10-31 16:07:55,516 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5246180269824711248_1086 size 238055
2013-10-31 16:07:55,516 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5246180269824711248_1086 size 238055
2013-10-31 16:07:55,522 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar. New replication is 10
2013-10-31 16:07:55,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar	dst=null	perm=null
2013-10-31 16:07:55,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,536 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:07:55,543 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:07:55,546 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:07:55,550 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:07:55,553 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:07:55,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,569 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split. New replication is 10
2013-10-31 16:07:55,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split	dst=null	perm=null
2013-10-31 16:07:55,577 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split. blk_-5994389290929950108_1087
2013-10-31 16:07:55,578 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5994389290929950108_1087 src: /127.0.0.1:34243 dest: /127.0.0.1:38271
2013-10-31 16:07:55,580 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5994389290929950108_1087 src: /127.0.0.1:34175 dest: /127.0.0.1:50942
2013-10-31 16:07:55,582 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5994389290929950108_1087 src: /127.0.0.1:47278 dest: /127.0.0.1:47311
2013-10-31 16:07:55,584 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5994389290929950108_1087 src: /127.0.0.1:54282 dest: /127.0.0.1:41648
2013-10-31 16:07:55,587 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54282, dest: /127.0.0.1:41648, bytes: 1728, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5994389290929950108_1087, duration: 82744
2013-10-31 16:07:55,587 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5994389290929950108_1087 terminating
2013-10-31 16:07:55,588 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47278, dest: /127.0.0.1:47311, bytes: 1728, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5994389290929950108_1087, duration: 898482
2013-10-31 16:07:55,588 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5994389290929950108_1087 terminating
2013-10-31 16:07:55,588 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5994389290929950108_1087 size 1728
2013-10-31 16:07:55,589 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34175, dest: /127.0.0.1:50942, bytes: 1728, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5994389290929950108_1087, duration: 1930862
2013-10-31 16:07:55,589 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5994389290929950108_1087 size 1728
2013-10-31 16:07:55,589 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5994389290929950108_1087 terminating
2013-10-31 16:07:55,590 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34243, dest: /127.0.0.1:38271, bytes: 1728, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5994389290929950108_1087, duration: 2979880
2013-10-31 16:07:55,590 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5994389290929950108_1087 terminating
2013-10-31 16:07:55,592 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5994389290929950108_1087 size 1728
2013-10-31 16:07:55,593 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split from client DFSClient_1457307213
2013-10-31 16:07:55,593 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split is closed by DFSClient_1457307213
2013-10-31 16:07:55,594 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5994389290929950108_1087 size 1728
2013-10-31 16:07:55,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,614 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo. blk_-9066677134869793311_1088
2013-10-31 16:07:55,616 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9066677134869793311_1088 src: /127.0.0.1:47280 dest: /127.0.0.1:47311
2013-10-31 16:07:55,617 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9066677134869793311_1088 src: /127.0.0.1:34248 dest: /127.0.0.1:38271
2013-10-31 16:07:55,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9066677134869793311_1088 src: /127.0.0.1:54285 dest: /127.0.0.1:41648
2013-10-31 16:07:55,622 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54285, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9066677134869793311_1088, duration: 87768
2013-10-31 16:07:55,622 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9066677134869793311_1088 terminating
2013-10-31 16:07:55,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34248, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9066677134869793311_1088, duration: 900226
2013-10-31 16:07:55,623 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9066677134869793311_1088 terminating
2013-10-31 16:07:55,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47280, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9066677134869793311_1088, duration: 1861132
2013-10-31 16:07:55,624 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9066677134869793311_1088 terminating
2013-10-31 16:07:55,626 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9066677134869793311_1088 size 183
2013-10-31 16:07:55,626 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:07:55,627 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:07:55,627 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9066677134869793311_1088 size 183
2013-10-31 16:07:55,628 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-9066677134869793311_1088 size 183
2013-10-31 16:07:55,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,661 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml. blk_9146458358321234612_1089
2013-10-31 16:07:55,663 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9146458358321234612_1089 src: /127.0.0.1:34181 dest: /127.0.0.1:50942
2013-10-31 16:07:55,664 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9146458358321234612_1089 src: /127.0.0.1:47284 dest: /127.0.0.1:47311
2013-10-31 16:07:55,666 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9146458358321234612_1089 src: /127.0.0.1:34252 dest: /127.0.0.1:38271
2013-10-31 16:07:55,669 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34252, dest: /127.0.0.1:38271, bytes: 30306, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9146458358321234612_1089, duration: 264055
2013-10-31 16:07:55,669 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9146458358321234612_1089 terminating
2013-10-31 16:07:55,669 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47284, dest: /127.0.0.1:47311, bytes: 30306, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_9146458358321234612_1089, duration: 1019253
2013-10-31 16:07:55,670 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9146458358321234612_1089 terminating
2013-10-31 16:07:55,670 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_9146458358321234612_1089 size 30306
2013-10-31 16:07:55,671 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34181, dest: /127.0.0.1:50942, bytes: 30306, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_9146458358321234612_1089, duration: 1900452
2013-10-31 16:07:55,671 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9146458358321234612_1089 terminating
2013-10-31 16:07:55,673 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_9146458358321234612_1089 size 30306
2013-10-31 16:07:55,674 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml from client DFSClient_1457307213
2013-10-31 16:07:55,674 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml is closed by DFSClient_1457307213
2013-10-31 16:07:55,675 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_9146458358321234612_1089 size 30306
2013-10-31 16:07:55,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml	dst=null	perm=null
2013-10-31 16:07:55,692 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34185, bytes: 30546, op: HDFS_READ, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_9146458358321234612_1089, duration: 409722
2013-10-31 16:07:55,711 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0008: nMaps=5 nReduces=1 max=-1
2013-10-31 16:07:55,712 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0008 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:07:55,712 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0008	RESULT=SUCCESS
2013-10-31 16:07:55,712 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0008
2013-10-31 16:07:55,712 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0008
2013-10-31 16:07:55,713 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0008
2013-10-31 16:07:56,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:56,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:56,212 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_conf.xml. blk_5232852608287245330_1091
2013-10-31 16:07:56,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5232852608287245330_1091 src: /127.0.0.1:34255 dest: /127.0.0.1:38271
2013-10-31 16:07:56,216 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5232852608287245330_1091 src: /127.0.0.1:47289 dest: /127.0.0.1:47311
2013-10-31 16:07:56,218 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5232852608287245330_1091 src: /127.0.0.1:54293 dest: /127.0.0.1:41648
2013-10-31 16:07:56,222 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54293, dest: /127.0.0.1:41648, bytes: 30371, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5232852608287245330_1091, duration: 751986
2013-10-31 16:07:56,222 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5232852608287245330_1091 terminating
2013-10-31 16:07:56,222 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5232852608287245330_1091 size 30371
2013-10-31 16:07:56,223 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47289, dest: /127.0.0.1:47311, bytes: 30371, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5232852608287245330_1091, duration: 1526398
2013-10-31 16:07:56,223 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5232852608287245330_1091 terminating
2013-10-31 16:07:56,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34255, dest: /127.0.0.1:38271, bytes: 30371, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5232852608287245330_1091, duration: 2891370
2013-10-31 16:07:56,224 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5232852608287245330_1091 terminating
2013-10-31 16:07:56,225 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5232852608287245330_1091 size 30371
2013-10-31 16:07:56,226 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_conf.xml from client DFSClient_-1075809185
2013-10-31 16:07:56,226 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_conf.xml is closed by DFSClient_-1075809185
2013-10-31 16:07:56,227 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5232852608287245330_1091 size 30371
2013-10-31 16:07:56,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:56,242 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken. blk_6292824092672117012_1092
2013-10-31 16:07:56,243 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6292824092672117012_1092 src: /127.0.0.1:54294 dest: /127.0.0.1:41648
2013-10-31 16:07:56,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6292824092672117012_1092 src: /127.0.0.1:34190 dest: /127.0.0.1:50942
2013-10-31 16:07:56,247 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6292824092672117012_1092 src: /127.0.0.1:34260 dest: /127.0.0.1:38271
2013-10-31 16:07:56,249 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34260, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6292824092672117012_1092, duration: 63904
2013-10-31 16:07:56,250 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6292824092672117012_1092 terminating
2013-10-31 16:07:56,250 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6292824092672117012_1092 size 116
2013-10-31 16:07:56,250 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34190, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6292824092672117012_1092, duration: 832527
2013-10-31 16:07:56,251 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6292824092672117012_1092 terminating
2013-10-31 16:07:56,251 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54294, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6292824092672117012_1092, duration: 1757402
2013-10-31 16:07:56,252 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6292824092672117012_1092 terminating
2013-10-31 16:07:56,254 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6292824092672117012_1092 size 116
2013-10-31 16:07:56,255 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken from client DFSClient_1457307213
2013-10-31 16:07:56,255 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken is closed by DFSClient_1457307213
2013-10-31 16:07:56,256 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6292824092672117012_1092 size 116
2013-10-31 16:07:56,260 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken
2013-10-31 16:07:56,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:07:56,265 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47294, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9066677134869793311_1088, duration: 276494
2013-10-31 16:07:56,266 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0008 = 70. Number of splits = 5
2013-10-31 16:07:56,266 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,267 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,267 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,267 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,267 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,268 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,268 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,268 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,268 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,269 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,269 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,269 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,269 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,270 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,270 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,270 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0008 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:07:56,271 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0008 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:07:56,687 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4067490714316058154_1077 file build/test/data/dfs/data/data1/current/blk_-4067490714316058154 for deletion
2013-10-31 16:07:56,687 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2028997783111402336_1076 file build/test/data/dfs/data/data2/current/blk_2028997783111402336 for deletion
2013-10-31 16:07:56,687 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4067490714316058154_1077 at file build/test/data/dfs/data/data1/current/blk_-4067490714316058154
2013-10-31 16:07:56,687 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8838228819783861941_1075 file build/test/data/dfs/data/data1/current/blk_8838228819783861941 for deletion
2013-10-31 16:07:56,687 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2028997783111402336_1076 at file build/test/data/dfs/data/data2/current/blk_2028997783111402336
2013-10-31 16:07:56,688 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8838228819783861941_1075 at file build/test/data/dfs/data/data1/current/blk_8838228819783861941
2013-10-31 16:07:57,186 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_5246180269824711248_1086 to datanode(s) 127.0.0.1:50942
2013-10-31 16:07:57,187 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_6149960951356387480_1068 blk_7203448194588732562_1068 blk_2693516798230755184_1072 blk_2997245466678193792_1071 blk_-7119686764560670206_1073 blk_2659110045914674593_1074
2013-10-31 16:07:57,187 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_6149960951356387480_1068 blk_7203448194588732562_1068 blk_2997245466678193792_1071 blk_-7119686764560670206_1073 blk_-8749881692688222416_1081 blk_2659110045914674593_1074
2013-10-31 16:07:57,287 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8749881692688222416_1081 file build/test/data/dfs/data/data3/current/blk_-8749881692688222416 for deletion
2013-10-31 16:07:57,287 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7119686764560670206_1073 file build/test/data/dfs/data/data3/current/blk_-7119686764560670206 for deletion
2013-10-31 16:07:57,287 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8749881692688222416_1081 at file build/test/data/dfs/data/data3/current/blk_-8749881692688222416
2013-10-31 16:07:57,287 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2659110045914674593_1074 file build/test/data/dfs/data/data4/current/blk_2659110045914674593 for deletion
2013-10-31 16:07:57,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7119686764560670206_1073 at file build/test/data/dfs/data/data3/current/blk_-7119686764560670206
2013-10-31 16:07:57,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2997245466678193792_1071 file build/test/data/dfs/data/data4/current/blk_2997245466678193792 for deletion
2013-10-31 16:07:57,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2659110045914674593_1074 at file build/test/data/dfs/data/data4/current/blk_2659110045914674593
2013-10-31 16:07:57,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6149960951356387480_1068 file build/test/data/dfs/data/data4/current/blk_6149960951356387480 for deletion
2013-10-31 16:07:57,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2997245466678193792_1071 at file build/test/data/dfs/data/data4/current/blk_2997245466678193792
2013-10-31 16:07:57,289 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7203448194588732562_1068 file build/test/data/dfs/data/data3/current/blk_7203448194588732562 for deletion
2013-10-31 16:07:57,289 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6149960951356387480_1068 at file build/test/data/dfs/data/data4/current/blk_6149960951356387480
2013-10-31 16:07:57,289 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7203448194588732562_1068 at file build/test/data/dfs/data/data3/current/blk_7203448194588732562
2013-10-31 16:07:57,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7119686764560670206_1073 file build/test/data/dfs/data/data6/current/blk_-7119686764560670206 for deletion
2013-10-31 16:07:57,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2659110045914674593_1074 file build/test/data/dfs/data/data5/current/blk_2659110045914674593 for deletion
2013-10-31 16:07:57,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7119686764560670206_1073 at file build/test/data/dfs/data/data6/current/blk_-7119686764560670206
2013-10-31 16:07:57,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2693516798230755184_1072 file build/test/data/dfs/data/data5/current/blk_2693516798230755184 for deletion
2013-10-31 16:07:57,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2659110045914674593_1074 at file build/test/data/dfs/data/data5/current/blk_2659110045914674593
2013-10-31 16:07:57,901 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2997245466678193792_1071 file build/test/data/dfs/data/data6/current/blk_2997245466678193792 for deletion
2013-10-31 16:07:57,901 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2693516798230755184_1072 at file build/test/data/dfs/data/data5/current/blk_2693516798230755184
2013-10-31 16:07:57,901 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6149960951356387480_1068 file build/test/data/dfs/data/data5/current/blk_6149960951356387480 for deletion
2013-10-31 16:07:57,901 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2997245466678193792_1071 at file build/test/data/dfs/data/data6/current/blk_2997245466678193792
2013-10-31 16:07:57,902 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7203448194588732562_1068 file build/test/data/dfs/data/data6/current/blk_7203448194588732562 for deletion
2013-10-31 16:07:57,902 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6149960951356387480_1068 at file build/test/data/dfs/data/data5/current/blk_6149960951356387480
2013-10-31 16:07:57,902 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7203448194588732562_1068 at file build/test/data/dfs/data/data6/current/blk_7203448194588732562
2013-10-31 16:07:58,029 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0008_m_000006_0' to tip task_20131031160444934_0008_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:07:58,037 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:07:58,037 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000006_0 which needs 1 slots
2013-10-31 16:07:58,037 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0007
2013-10-31 16:07:58,038 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000006_0 which needs 1 slots
2013-10-31 16:07:58,038 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0007 being deleted.
2013-10-31 16:07:58,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken	dst=null	perm=null
2013-10-31 16:07:58,047 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34193, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6292824092672117012_1092, duration: 376001
2013-10-31 16:07:58,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml	dst=null	perm=null
2013-10-31 16:07:58,061 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34195, bytes: 30546, op: HDFS_READ, cliID: DFSClient_1401612830, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_9146458358321234612_1089, duration: 390529
2013-10-31 16:07:58,095 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:58,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar	dst=null	perm=null
2013-10-31 16:07:58,119 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54301, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1401612830, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5246180269824711248_1086, duration: 665306
2013-10-31 16:07:58,200 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_2020654016
2013-10-31 16:07:58,201 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_2020654016 spawned.
2013-10-31 16:07:58,203 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000006_0/taskjvm.sh
2013-10-31 16:07:59,417 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_2020654016 given task: attempt_20131031160444934_0008_m_000006_0
2013-10-31 16:07:59,687 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_5246180269824711248_1086 to 127.0.0.1:50942 
2013-10-31 16:07:59,688 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5246180269824711248_1086 src: /127.0.0.1:34198 dest: /127.0.0.1:50942
2013-10-31 16:07:59,688 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_5246180269824711248_1086 to /127.0.0.1:50942
2013-10-31 16:07:59,690 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5246180269824711248_1086 src: /127.0.0.1:34198 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:07:59,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5246180269824711248_1086 size 238055
2013-10-31 16:07:59,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:00,067 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0007
2013-10-31 16:08:00,067 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0007_m_000001_0 not found in cache
2013-10-31 16:08:00,067 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0007_m_000000_0 not found in cache
2013-10-31 16:08:00,068 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0007 for user-log deletion with retainTimeStamp:1383322080067
2013-10-31 16:08:00,188 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_7203448194588732562_1068 blk_2693516798230755184_1072 blk_2997245466678193792_1071 blk_-8749881692688222416_1081 blk_2659110045914674593_1074
2013-10-31 16:08:00,188 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_6149960951356387480_1068 blk_2693516798230755184_1072 blk_-7119686764560670206_1073 blk_-8749881692688222416_1081
2013-10-31 16:08:00,639 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0007_m_-1232237882 since job job_20131031160444934_0007 is dead
2013-10-31 16:08:00,650 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13803 with signal TERM. Exit code 0
2013-10-31 16:08:00,813 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:00,814 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:00,814 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:00,814 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0007_m_-1232237882 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:08:01,410 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0007_m_-769706857 since job job_20131031160444934_0007 is dead
2013-10-31 16:08:01,419 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13995 with signal TERM. Exit code 0
2013-10-31 16:08:01,592 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:01,593 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:01,593 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:01,593 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0007_m_-769706857 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:01,895 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3549128818189452633_1056
2013-10-31 16:08:02,689 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8749881692688222416_1081 file build/test/data/dfs/data/data1/current/blk_-8749881692688222416 for deletion
2013-10-31 16:08:02,689 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7119686764560670206_1073 file build/test/data/dfs/data/data2/current/blk_-7119686764560670206 for deletion
2013-10-31 16:08:02,689 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8749881692688222416_1081 at file build/test/data/dfs/data/data1/current/blk_-8749881692688222416
2013-10-31 16:08:02,690 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2693516798230755184_1072 file build/test/data/dfs/data/data1/current/blk_2693516798230755184 for deletion
2013-10-31 16:08:02,690 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7119686764560670206_1073 at file build/test/data/dfs/data/data2/current/blk_-7119686764560670206
2013-10-31 16:08:02,690 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2693516798230755184_1072 at file build/test/data/dfs/data/data1/current/blk_2693516798230755184
2013-10-31 16:08:02,690 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6149960951356387480_1068 file build/test/data/dfs/data/data2/current/blk_6149960951356387480 for deletion
2013-10-31 16:08:02,691 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6149960951356387480_1068 at file build/test/data/dfs/data/data2/current/blk_6149960951356387480
2013-10-31 16:08:02,887 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000006_0 0.0% setup
2013-10-31 16:08:02,889 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000006_0 is done.
2013-10-31 16:08:02,890 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000006_0  was -1
2013-10-31 16:08:02,890 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:02,891 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8749881692688222416_1081 file build/test/data/dfs/data/data8/current/blk_-8749881692688222416 for deletion
2013-10-31 16:08:02,891 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2659110045914674593_1074 file build/test/data/dfs/data/data7/current/blk_2659110045914674593 for deletion
2013-10-31 16:08:02,891 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8749881692688222416_1081 at file build/test/data/dfs/data/data8/current/blk_-8749881692688222416
2013-10-31 16:08:02,891 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2693516798230755184_1072 file build/test/data/dfs/data/data8/current/blk_2693516798230755184 for deletion
2013-10-31 16:08:02,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2659110045914674593_1074 at file build/test/data/dfs/data/data7/current/blk_2659110045914674593
2013-10-31 16:08:02,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2997245466678193792_1071 file build/test/data/dfs/data/data7/current/blk_2997245466678193792 for deletion
2013-10-31 16:08:02,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2693516798230755184_1072 at file build/test/data/dfs/data/data8/current/blk_2693516798230755184
2013-10-31 16:08:02,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2997245466678193792_1071 at file build/test/data/dfs/data/data7/current/blk_2997245466678193792
2013-10-31 16:08:02,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7203448194588732562_1068 file build/test/data/dfs/data/data7/current/blk_7203448194588732562 for deletion
2013-10-31 16:08:02,893 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7203448194588732562_1068 at file build/test/data/dfs/data/data7/current/blk_7203448194588732562
2013-10-31 16:08:04,044 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000006_0' has completed task_20131031160444934_0008_m_000006 successfully.
2013-10-31 16:08:04,048 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000000_0' to tip task_20131031160444934_0008_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:04,049 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000000
2013-10-31 16:08:04,050 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000001_0' to tip task_20131031160444934_0008_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:04,050 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000001
2013-10-31 16:08:04,052 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:08:04,053 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:08:04,053 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000000_0 which needs 1 slots
2013-10-31 16:08:04,053 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000000_0 which needs 1 slots
2013-10-31 16:08:04,054 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000001_0 which needs 1 slots
2013-10-31 16:08:04,054 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0008_m_000001_0 which needs 1 slots
2013-10-31 16:08:04,078 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000002_0' to tip task_20131031160444934_0008_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:08:04,078 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000002
2013-10-31 16:08:04,079 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000003_0' to tip task_20131031160444934_0008_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:08:04,079 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000003
2013-10-31 16:08:04,081 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:08:04,083 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:08:04,083 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000002_0 which needs 1 slots
2013-10-31 16:08:04,083 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000002_0 which needs 1 slots
2013-10-31 16:08:04,084 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000003_0 which needs 1 slots
2013-10-31 16:08:04,084 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0008_m_000003_0 which needs 1 slots
2013-10-31 16:08:04,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken	dst=null	perm=null
2013-10-31 16:08:04,092 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34201, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6292824092672117012_1092, duration: 147503
2013-10-31 16:08:04,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml	dst=null	perm=null
2013-10-31 16:08:04,096 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_1814522490
2013-10-31 16:08:04,097 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_1814522490 spawned.
2013-10-31 16:08:04,097 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0008/attempt_20131031160444934_0008_m_000001_0. Attempting to reuse: jvm_20131031160444934_0008_m_2020654016
2013-10-31 16:08:04,098 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34272, bytes: 30546, op: HDFS_READ, cliID: DFSClient_-2022843958, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9146458358321234612_1089, duration: 181119
2013-10-31 16:08:04,098 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000000_0/taskjvm.sh
2013-10-31 16:08:04,111 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:04,111 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000004_0' to tip task_20131031160444934_0008_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:04,111 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000004
2013-10-31 16:08:04,112 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:08:04,112 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000004_0 which needs 1 slots
2013-10-31 16:08:04,112 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000004_0 which needs 1 slots
2013-10-31 16:08:04,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken	dst=null	perm=null
2013-10-31 16:08:04,116 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34204, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6292824092672117012_1092, duration: 124814
2013-10-31 16:08:04,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml	dst=null	perm=null
2013-10-31 16:08:04,121 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34275, bytes: 30546, op: HDFS_READ, cliID: DFSClient_1391104543, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9146458358321234612_1089, duration: 162719
2013-10-31 16:08:04,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar	dst=null	perm=null
2013-10-31 16:08:04,126 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54312, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2022843958, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5246180269824711248_1086, duration: 664283
2013-10-31 16:08:04,133 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:04,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar	dst=null	perm=null
2013-10-31 16:08:04,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54313, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1391104543, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5246180269824711248_1086, duration: 661022
2013-10-31 16:08:04,204 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_1494613078
2013-10-31 16:08:04,205 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_1494613078 spawned.
2013-10-31 16:08:04,205 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000004_0/taskjvm.sh
2013-10-31 16:08:04,248 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_-1041693586
2013-10-31 16:08:04,250 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_-1041693586 spawned.
2013-10-31 16:08:04,251 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_-1761742138
2013-10-31 16:08:04,253 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_-1761742138 spawned.
2013-10-31 16:08:04,255 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000003_0/taskjvm.sh
2013-10-31 16:08:04,255 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000002_0/taskjvm.sh
2013-10-31 16:08:04,448 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_2020654016 given task: attempt_20131031160444934_0008_m_000001_0
2013-10-31 16:08:04,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split	dst=null	perm=null
2013-10-31 16:08:04,565 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47312, bytes: 1744, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5994389290929950108_1087, duration: 170453
2013-10-31 16:08:04,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:08:04,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54316, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 150772
2013-10-31 16:08:05,457 INFO  mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031160444934_0008_m_000000_0 is 1406 ms debug.
2013-10-31 16:08:05,515 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_1494613078 given task: attempt_20131031160444934_0008_m_000004_0
2013-10-31 16:08:05,518 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_1814522490 given task: attempt_20131031160444934_0008_m_000000_0
2013-10-31 16:08:05,549 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_-1041693586 given task: attempt_20131031160444934_0008_m_000003_0
2013-10-31 16:08:05,560 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_-1761742138 given task: attempt_20131031160444934_0008_m_000002_0
2013-10-31 16:08:06,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split	dst=null	perm=null
2013-10-31 16:08:06,017 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47322, bytes: 712, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5994389290929950108_1087, duration: 167596
2013-10-31 16:08:06,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split	dst=null	perm=null
2013-10-31 16:08:06,046 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54326, bytes: 1744, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5994389290929950108_1087, duration: 170382
2013-10-31 16:08:06,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split	dst=null	perm=null
2013-10-31 16:08:06,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:06,057 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47324, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 130236
2013-10-31 16:08:06,058 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34292, bytes: 712, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5994389290929950108_1087, duration: 151815
2013-10-31 16:08:06,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split	dst=null	perm=null
2013-10-31 16:08:06,069 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34293, bytes: 1228, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5994389290929950108_1087, duration: 147284
2013-10-31 16:08:06,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:08:06,086 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34294, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 112170
2013-10-31 16:08:06,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:06,100 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47328, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 137236
2013-10-31 16:08:06,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:06,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:06,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:06,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47329, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 134093
2013-10-31 16:08:06,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:08:06,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:08:06,362 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34297, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 104086
2013-10-31 16:08:06,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:06,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:06,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54334, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 152294
2013-10-31 16:08:06,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:06,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:06,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:08:06,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:08:06,404 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34299, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 114865
2013-10-31 16:08:06,405 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34231, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 115003
2013-10-31 16:08:06,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:08:06,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:08:06,411 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34301, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 105236
2013-10-31 16:08:06,414 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47335, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 517496
2013-10-31 16:08:07,530 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:0+25
2013-10-31 16:08:07,533 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000001_0 is done.
2013-10-31 16:08:07,533 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000001_0  was 139
2013-10-31 16:08:07,533 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:08:08,946 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000004_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:18+1
2013-10-31 16:08:08,949 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000004_0 is done.
2013-10-31 16:08:08,949 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000004_0  was 6
2013-10-31 16:08:08,949 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:08,961 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:25+26
2013-10-31 16:08:08,963 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000000_0 is done.
2013-10-31 16:08:08,963 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000000_0  was 120
2013-10-31 16:08:08,964 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:08,984 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:9+9
2013-10-31 16:08:08,986 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000003_0 is done.
2013-10-31 16:08:08,986 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000003_0  was 264
2013-10-31 16:08:08,986 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:08:08,994 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+9
2013-10-31 16:08:08,995 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000002_0 is done.
2013-10-31 16:08:08,995 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000002_0  was 307
2013-10-31 16:08:08,996 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:09,053 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0008_m_000006_0
2013-10-31 16:08:09,054 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0008_m_000006_0
2013-10-31 16:08:09,054 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0008_m_000006_0 not found in cache
2013-10-31 16:08:10,060 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000000_0' has completed task_20131031160444934_0008_m_000000 successfully.
2013-10-31 16:08:10,309 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000001_0' has completed task_20131031160444934_0008_m_000001 successfully.
2013-10-31 16:08:10,311 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0008_r_000000_0' to tip task_20131031160444934_0008_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:10,312 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000004_0' has completed task_20131031160444934_0008_m_000004 successfully.
2013-10-31 16:08:10,314 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:08:10,315 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_r_000000_0 which needs 1 slots
2013-10-31 16:08:10,315 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_r_000000_0 which needs 1 slots
2013-10-31 16:08:10,316 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000002_0' has completed task_20131031160444934_0008_m_000002 successfully.
2013-10-31 16:08:10,319 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000003_0' has completed task_20131031160444934_0008_m_000003 successfully.
2013-10-31 16:08:10,355 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_r_331271179
2013-10-31 16:08:10,356 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_r_331271179 spawned.
2013-10-31 16:08:10,358 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_r_000000_0/taskjvm.sh
2013-10-31 16:08:11,717 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_r_331271179 given task: attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:17,391 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42163, bytes: 120, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000000_0, duration: 6115077
2013-10-31 16:08:17,405 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42163, bytes: 139, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000001_0, duration: 8054576
2013-10-31 16:08:17,421 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:46837, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000004_0, duration: 12375516
2013-10-31 16:08:17,438 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57963, bytes: 307, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000002_0, duration: 11996710
2013-10-31 16:08:17,454 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57963, bytes: 264, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000003_0, duration: 12450949
2013-10-31 16:08:18,204 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:08:18,259 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:08:18,312 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:08:18,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:18,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:18,558 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000. blk_3930024885769886491_1093
2013-10-31 16:08:18,589 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3930024885769886491_1093 src: /127.0.0.1:54344 dest: /127.0.0.1:41648
2013-10-31 16:08:18,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3930024885769886491_1093 src: /127.0.0.1:34240 dest: /127.0.0.1:50942
2013-10-31 16:08:18,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3930024885769886491_1093 src: /127.0.0.1:34310 dest: /127.0.0.1:38271
2013-10-31 16:08:18,595 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34310, dest: /127.0.0.1:38271, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0008_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3930024885769886491_1093, duration: 1880169
2013-10-31 16:08:18,596 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3930024885769886491_1093 terminating
2013-10-31 16:08:18,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34240, dest: /127.0.0.1:50942, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0008_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3930024885769886491_1093, duration: 3059353
2013-10-31 16:08:18,596 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3930024885769886491_1093 terminating
2013-10-31 16:08:18,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54344, dest: /127.0.0.1:41648, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0008_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3930024885769886491_1093, duration: 3541650
2013-10-31 16:08:18,596 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3930024885769886491_1093 terminating
2013-10-31 16:08:18,601 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3930024885769886491_1093 size 592
2013-10-31 16:08:18,601 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:18,601 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:18,601 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3930024885769886491_1093 size 592
2013-10-31 16:08:18,601 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3930024885769886491_1093 size 592
2013-10-31 16:08:18,639 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0008_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:18,639 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:08:19,324 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031160444934_0008_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:55789
2013-10-31 16:08:19,325 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:19,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0	dst=null	perm=null
2013-10-31 16:08:19,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:19,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:19,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0	dst=null	perm=null
2013-10-31 16:08:21,252 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 1.0% reduce > reduce
2013-10-31 16:08:21,255 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 1.0% reduce > reduce
2013-10-31 16:08:21,256 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_r_000000_0 is done.
2013-10-31 16:08:21,256 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_r_000000_0  was -1
2013-10-31 16:08:21,258 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:22,328 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_r_000000_0' has completed task_20131031160444934_0008_r_000000 successfully.
2013-10-31 16:08:22,333 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0008_m_000005_0' to tip task_20131031160444934_0008_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:22,336 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:08:22,337 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000005_0 which needs 1 slots
2013-10-31 16:08:22,337 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000005_0 which needs 1 slots
2013-10-31 16:08:22,376 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0008/attempt_20131031160444934_0008_m_000005_0. Attempting to reuse: jvm_20131031160444934_0008_m_1814522490
2013-10-31 16:08:23,029 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_1814522490 given task: attempt_20131031160444934_0008_m_000005_0
2013-10-31 16:08:23,182 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000005_0 0.0% 
2013-10-31 16:08:23,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary	dst=null	perm=null
2013-10-31 16:08:23,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:23,199 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS from client DFSClient_attempt_20131031160444934_0008_m_000005_0
2013-10-31 16:08:23,199 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0008_m_000005_0
2013-10-31 16:08:23,204 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5246180269824711248 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:23,204 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5246180269824711248 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:23,204 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5246180269824711248 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5246180269824711248 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5994389290929950108 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5994389290929950108 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5994389290929950108 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5994389290929950108 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9066677134869793311 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9066677134869793311 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9066677134869793311 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9146458358321234612 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9146458358321234612 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:23,205 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9146458358321234612 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:23,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008	dst=null	perm=null
2013-10-31 16:08:24,192 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_9146458358321234612_1089 blk_5246180269824711248_1086 blk_-5994389290929950108_1087
2013-10-31 16:08:24,192 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_9146458358321234612_1089 blk_-9066677134869793311_1088 blk_5246180269824711248_1086 blk_-5994389290929950108_1087
2013-10-31 16:08:24,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9066677134869793311_1088 file build/test/data/dfs/data/data3/current/blk_-9066677134869793311 for deletion
2013-10-31 16:08:24,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5994389290929950108_1087 file build/test/data/dfs/data/data4/current/blk_-5994389290929950108 for deletion
2013-10-31 16:08:24,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9066677134869793311_1088 at file build/test/data/dfs/data/data3/current/blk_-9066677134869793311
2013-10-31 16:08:24,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5246180269824711248_1086 file build/test/data/dfs/data/data3/current/blk_5246180269824711248 for deletion
2013-10-31 16:08:24,297 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5994389290929950108_1087 at file build/test/data/dfs/data/data4/current/blk_-5994389290929950108
2013-10-31 16:08:24,297 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9146458358321234612_1089 file build/test/data/dfs/data/data4/current/blk_9146458358321234612 for deletion
2013-10-31 16:08:24,297 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5246180269824711248_1086 at file build/test/data/dfs/data/data3/current/blk_5246180269824711248
2013-10-31 16:08:24,297 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9146458358321234612_1089 at file build/test/data/dfs/data/data4/current/blk_9146458358321234612
2013-10-31 16:08:26,133 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000005_0 0.0% cleanup
2013-10-31 16:08:26,135 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000005_0 is done.
2013-10-31 16:08:26,135 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000005_0  was -1
2013-10-31 16:08:26,136 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:26,899 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5994389290929950108_1087 file build/test/data/dfs/data/data7/current/blk_-5994389290929950108 for deletion
2013-10-31 16:08:26,899 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5246180269824711248_1086 file build/test/data/dfs/data/data8/current/blk_5246180269824711248 for deletion
2013-10-31 16:08:26,899 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5994389290929950108_1087 at file build/test/data/dfs/data/data7/current/blk_-5994389290929950108
2013-10-31 16:08:26,899 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9146458358321234612_1089 file build/test/data/dfs/data/data8/current/blk_9146458358321234612 for deletion
2013-10-31 16:08:26,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5246180269824711248_1086 at file build/test/data/dfs/data/data8/current/blk_5246180269824711248
2013-10-31 16:08:26,900 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9146458358321234612_1089 at file build/test/data/dfs/data/data8/current/blk_9146458358321234612
2013-10-31 16:08:27,193 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-9066677134869793311_1088 blk_5246180269824711248_1086 blk_-5994389290929950108_1087
2013-10-31 16:08:27,193 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_9146458358321234612_1089 blk_-9066677134869793311_1088 blk_5246180269824711248_1086 blk_-5994389290929950108_1087
2013-10-31 16:08:27,337 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:27,337 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:27,910 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9066677134869793311_1088 file build/test/data/dfs/data/data6/current/blk_-9066677134869793311 for deletion
2013-10-31 16:08:27,910 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5994389290929950108_1087 file build/test/data/dfs/data/data5/current/blk_-5994389290929950108 for deletion
2013-10-31 16:08:27,910 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9066677134869793311_1088 at file build/test/data/dfs/data/data6/current/blk_-9066677134869793311
2013-10-31 16:08:27,910 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5246180269824711248_1086 file build/test/data/dfs/data/data6/current/blk_5246180269824711248 for deletion
2013-10-31 16:08:27,911 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5994389290929950108_1087 at file build/test/data/dfs/data/data5/current/blk_-5994389290929950108
2013-10-31 16:08:27,911 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5246180269824711248_1086 at file build/test/data/dfs/data/data6/current/blk_5246180269824711248
2013-10-31 16:08:28,344 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000005_0' has completed task_20131031160444934_0008_m_000005 successfully.
2013-10-31 16:08:28,367 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0008 has completed successfully.
2013-10-31 16:08:28,368 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0008,submitTime=1383235675682,launchTime=1383235676270,firstMapTaskLaunchTime=1383235684048,firstReduceTaskLaunchTime=1383235690311,firstJobSetupTaskLaunchTime=1383235678029,firstJobCleanupTaskLaunchTime=1383235702333,finishTime=1383235708367,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[11675BC72682423490170FEA77B4B342/586B8937BCFE432FB0382FA5BC7D0906] cogrouping/(1/1) ...intocogrouplhsswappedjoin
2013-10-31 16:08:28,375 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F. blk_-9048123502738582374_1094
2013-10-31 16:08:28,376 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9048123502738582374_1094 src: /127.0.0.1:34244 dest: /127.0.0.1:50942
2013-10-31 16:08:28,379 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9048123502738582374_1094 src: /127.0.0.1:34314 dest: /127.0.0.1:38271
2013-10-31 16:08:28,381 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9048123502738582374_1094 src: /127.0.0.1:54351 dest: /127.0.0.1:41648
2013-10-31 16:08:28,386 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54351, dest: /127.0.0.1:41648, bytes: 31648, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9048123502738582374_1094, duration: 1903280
2013-10-31 16:08:28,387 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9048123502738582374_1094 terminating
2013-10-31 16:08:28,387 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34314, dest: /127.0.0.1:38271, bytes: 31648, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9048123502738582374_1094, duration: 2764854
2013-10-31 16:08:28,388 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9048123502738582374_1094 terminating
2013-10-31 16:08:28,388 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9048123502738582374_1094 size 31648
2013-10-31 16:08:28,388 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34244, dest: /127.0.0.1:50942, bytes: 31648, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9048123502738582374_1094, duration: 3879162
2013-10-31 16:08:28,388 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9048123502738582374_1094 terminating
2013-10-31 16:08:28,391 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F from client DFSClient_-1075809185
2013-10-31 16:08:28,392 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F is closed by DFSClient_-1075809185
2013-10-31 16:08:28,392 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9048123502738582374_1094 size 31648
2013-10-31 16:08:28,393 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-9048123502738582374_1094 size 31648
2013-10-31 16:08:28,401 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:08:28,401 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000000_0'
2013-10-31 16:08:28,402 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000001_0'
2013-10-31 16:08:28,402 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000005_0'
2013-10-31 16:08:28,402 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000006_0'
2013-10-31 16:08:28,403 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6292824092672117012 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:28,403 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_r_000000_0'
2013-10-31 16:08:28,404 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6292824092672117012 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:28,404 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6292824092672117012 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:28,405 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000002_0'
2013-10-31 16:08:28,405 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0008
2013-10-31 16:08:28,405 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000003_0'
2013-10-31 16:08:28,405 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0008 being deleted.
2013-10-31 16:08:28,406 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000004_0'
2013-10-31 16:08:28,413 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary
2013-10-31 16:08:28,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008	dst=null	perm=null
2013-10-31 16:08:28,430 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0008_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:08:28,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2013-10-31 16:08:28,472 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:28,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2013-10-31 16:08:28,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2013-10-31 16:08:28,478 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34317, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3930024885769886491_1093, duration: 434693
2013-10-31 16:08:28,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2013-10-31 16:08:28,495 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:28,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2013-10-31 16:08:28,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2013-10-31 16:08:28,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34249, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3930024885769886491_1093, duration: 439294
2013-10-31 16:08:28,499 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin
2013-10-31 16:08:28,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2013-10-31 16:08:28,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2013-10-31 16:08:28,505 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34250, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3930024885769886491_1093, duration: 407057
2013-10-31 16:08:28,531 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:08:28,532 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:08:28,570 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting
2013-10-31 16:08:28,570 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:08:28,571 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:08:28,571 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:08:28,571 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:08:28,572 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs"]
2013-10-31 16:08:28,572 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  parallel execution is enabled: true
2013-10-31 16:08:28,572 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  starting jobs: 2
2013-10-31 16:08:28,572 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  allocating threads: 2
2013-10-31 16:08:28,573 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (2/2)
2013-10-31 16:08:28,576 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:08:28,576 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:08:28,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:28,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:08:28,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,597 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar. blk_-407226121447423998_1095
2013-10-31 16:08:28,599 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-407226121447423998_1095 src: /127.0.0.1:47353 dest: /127.0.0.1:47311
2013-10-31 16:08:28,601 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-407226121447423998_1095 src: /127.0.0.1:54357 dest: /127.0.0.1:41648
2013-10-31 16:08:28,603 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-407226121447423998_1095 src: /127.0.0.1:34253 dest: /127.0.0.1:50942
2013-10-31 16:08:28,610 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34253, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-407226121447423998_1095, duration: 4188234
2013-10-31 16:08:28,611 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-407226121447423998_1095 terminating
2013-10-31 16:08:28,611 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54357, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-407226121447423998_1095, duration: 5433093
2013-10-31 16:08:28,612 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-407226121447423998_1095 terminating
2013-10-31 16:08:28,612 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47353, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-407226121447423998_1095, duration: 6208098
2013-10-31 16:08:28,613 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-407226121447423998_1095 terminating
2013-10-31 16:08:28,617 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-407226121447423998_1095 size 238055
2013-10-31 16:08:28,617 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar from client DFSClient_1457307213
2013-10-31 16:08:28,618 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar is closed by DFSClient_1457307213
2013-10-31 16:08:28,618 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-407226121447423998_1095 size 238055
2013-10-31 16:08:28,619 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-407226121447423998_1095 size 238055
2013-10-31 16:08:28,625 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar. New replication is 10
2013-10-31 16:08:28,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar	dst=null	perm=null
2013-10-31 16:08:28,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,638 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:08:28,643 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:28,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:28,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,662 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split. New replication is 10
2013-10-31 16:08:28,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split	dst=null	perm=null
2013-10-31 16:08:28,671 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split. blk_4549843032236031964_1096
2013-10-31 16:08:28,673 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4549843032236031964_1096 src: /127.0.0.1:54359 dest: /127.0.0.1:41648
2013-10-31 16:08:28,675 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4549843032236031964_1096 src: /127.0.0.1:34255 dest: /127.0.0.1:50942
2013-10-31 16:08:28,676 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4549843032236031964_1096 src: /127.0.0.1:47358 dest: /127.0.0.1:47311
2013-10-31 16:08:28,678 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4549843032236031964_1096 src: /127.0.0.1:34326 dest: /127.0.0.1:38271
2013-10-31 16:08:28,681 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34326, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4549843032236031964_1096, duration: 89957
2013-10-31 16:08:28,682 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4549843032236031964_1096 terminating
2013-10-31 16:08:28,682 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47358, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4549843032236031964_1096, duration: 869981
2013-10-31 16:08:28,683 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4549843032236031964_1096 terminating
2013-10-31 16:08:28,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34255, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4549843032236031964_1096, duration: 1915350
2013-10-31 16:08:28,683 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4549843032236031964_1096 terminating
2013-10-31 16:08:28,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54359, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4549843032236031964_1096, duration: 2705842
2013-10-31 16:08:28,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4549843032236031964_1096 terminating
2013-10-31 16:08:28,688 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4549843032236031964_1096 size 1732
2013-10-31 16:08:28,688 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split from client DFSClient_1457307213
2013-10-31 16:08:28,689 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split is closed by DFSClient_1457307213
2013-10-31 16:08:28,689 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4549843032236031964_1096 size 1732
2013-10-31 16:08:28,689 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4549843032236031964_1096 size 1732
2013-10-31 16:08:28,690 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4549843032236031964_1096 size 1732
2013-10-31 16:08:28,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,711 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo. blk_-1713806174407033772_1097
2013-10-31 16:08:28,712 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1713806174407033772_1097 src: /127.0.0.1:34327 dest: /127.0.0.1:38271
2013-10-31 16:08:28,714 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1713806174407033772_1097 src: /127.0.0.1:54364 dest: /127.0.0.1:41648
2013-10-31 16:08:28,716 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1713806174407033772_1097 src: /127.0.0.1:47362 dest: /127.0.0.1:47311
2013-10-31 16:08:28,718 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47362, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1713806174407033772_1097, duration: 60461
2013-10-31 16:08:28,719 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1713806174407033772_1097 terminating
2013-10-31 16:08:28,719 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54364, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1713806174407033772_1097, duration: 824895
2013-10-31 16:08:28,720 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1713806174407033772_1097 terminating
2013-10-31 16:08:28,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34327, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1713806174407033772_1097, duration: 1693295
2013-10-31 16:08:28,721 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1713806174407033772_1097 terminating
2013-10-31 16:08:28,725 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1713806174407033772_1097 size 183
2013-10-31 16:08:28,727 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1713806174407033772_1097 size 183
2013-10-31 16:08:28,728 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:08:28,728 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:08:28,728 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1713806174407033772_1097 size 183
2013-10-31 16:08:28,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,760 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml. blk_3851144484951187398_1098
2013-10-31 16:08:28,761 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3851144484951187398_1098 src: /127.0.0.1:47363 dest: /127.0.0.1:47311
2013-10-31 16:08:28,763 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3851144484951187398_1098 src: /127.0.0.1:54367 dest: /127.0.0.1:41648
2013-10-31 16:08:28,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3851144484951187398_1098 src: /127.0.0.1:34263 dest: /127.0.0.1:50942
2013-10-31 16:08:28,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34263, dest: /127.0.0.1:50942, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3851144484951187398_1098, duration: 978372
2013-10-31 16:08:28,768 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3851144484951187398_1098 terminating
2013-10-31 16:08:28,769 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54367, dest: /127.0.0.1:41648, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3851144484951187398_1098, duration: 933887
2013-10-31 16:08:28,769 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3851144484951187398_1098 terminating
2013-10-31 16:08:28,770 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47363, dest: /127.0.0.1:47311, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3851144484951187398_1098, duration: 2080700
2013-10-31 16:08:28,770 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3851144484951187398_1098 terminating
2013-10-31 16:08:28,772 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3851144484951187398_1098 size 28557
2013-10-31 16:08:28,772 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml from client DFSClient_1457307213
2013-10-31 16:08:28,772 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml is closed by DFSClient_1457307213
2013-10-31 16:08:28,773 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3851144484951187398_1098 size 28557
2013-10-31 16:08:28,774 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3851144484951187398_1098 size 28557
2013-10-31 16:08:28,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml	dst=null	perm=null
2013-10-31 16:08:28,790 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54370, bytes: 28781, op: HDFS_READ, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3851144484951187398_1098, duration: 394503
2013-10-31 16:08:28,812 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0009: nMaps=5 nReduces=0 max=-1
2013-10-31 16:08:28,812 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0009 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:08:28,812 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0009	RESULT=SUCCESS
2013-10-31 16:08:28,812 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0009
2013-10-31 16:08:28,813 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0009
2013-10-31 16:08:28,813 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0009
2013-10-31 16:08:29,698 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9066677134869793311_1088 file build/test/data/dfs/data/data2/current/blk_-9066677134869793311 for deletion
2013-10-31 16:08:29,698 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5994389290929950108_1087 file build/test/data/dfs/data/data1/current/blk_-5994389290929950108 for deletion
2013-10-31 16:08:29,698 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9066677134869793311_1088 at file build/test/data/dfs/data/data2/current/blk_-9066677134869793311
2013-10-31 16:08:29,699 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5246180269824711248_1086 file build/test/data/dfs/data/data2/current/blk_5246180269824711248 for deletion
2013-10-31 16:08:29,699 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5994389290929950108_1087 at file build/test/data/dfs/data/data1/current/blk_-5994389290929950108
2013-10-31 16:08:29,699 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9146458358321234612_1089 file build/test/data/dfs/data/data1/current/blk_9146458358321234612 for deletion
2013-10-31 16:08:29,699 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5246180269824711248_1086 at file build/test/data/dfs/data/data2/current/blk_5246180269824711248
2013-10-31 16:08:29,700 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9146458358321234612_1089 at file build/test/data/dfs/data/data1/current/blk_9146458358321234612
2013-10-31 16:08:29,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:29,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:29,874 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_conf.xml. blk_1737899946981776145_1100
2013-10-31 16:08:29,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1737899946981776145_1100 src: /127.0.0.1:34266 dest: /127.0.0.1:50942
2013-10-31 16:08:29,878 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1737899946981776145_1100 src: /127.0.0.1:34336 dest: /127.0.0.1:38271
2013-10-31 16:08:29,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1737899946981776145_1100 src: /127.0.0.1:47370 dest: /127.0.0.1:47311
2013-10-31 16:08:29,883 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47370, dest: /127.0.0.1:47311, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1737899946981776145_1100, duration: 774031
2013-10-31 16:08:29,884 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1737899946981776145_1100 terminating
2013-10-31 16:08:29,884 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1737899946981776145_1100 size 28622
2013-10-31 16:08:29,884 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34336, dest: /127.0.0.1:38271, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1737899946981776145_1100, duration: 1961466
2013-10-31 16:08:29,885 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1737899946981776145_1100 terminating
2013-10-31 16:08:29,885 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34266, dest: /127.0.0.1:50942, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1737899946981776145_1100, duration: 2752496
2013-10-31 16:08:29,886 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1737899946981776145_1100 size 28622
2013-10-31 16:08:29,886 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1737899946981776145_1100 terminating
2013-10-31 16:08:29,889 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1737899946981776145_1100 size 28622
2013-10-31 16:08:29,890 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_conf.xml from client DFSClient_1060990612
2013-10-31 16:08:29,890 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_conf.xml is closed by DFSClient_1060990612
2013-10-31 16:08:29,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:29,905 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken. blk_3766954078002236334_1101
2013-10-31 16:08:29,907 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3766954078002236334_1101 src: /127.0.0.1:54374 dest: /127.0.0.1:41648
2013-10-31 16:08:29,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3766954078002236334_1101 src: /127.0.0.1:47372 dest: /127.0.0.1:47311
2013-10-31 16:08:29,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3766954078002236334_1101 src: /127.0.0.1:34340 dest: /127.0.0.1:38271
2013-10-31 16:08:29,913 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34340, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3766954078002236334_1101, duration: 68268
2013-10-31 16:08:29,913 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3766954078002236334_1101 terminating
2013-10-31 16:08:29,913 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3766954078002236334_1101 size 116
2013-10-31 16:08:29,914 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47372, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3766954078002236334_1101, duration: 857830
2013-10-31 16:08:29,914 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3766954078002236334_1101 size 116
2013-10-31 16:08:29,915 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3766954078002236334_1101 terminating
2013-10-31 16:08:29,915 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54374, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3766954078002236334_1101, duration: 2116843
2013-10-31 16:08:29,916 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3766954078002236334_1101 terminating
2013-10-31 16:08:29,917 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3766954078002236334_1101 size 116
2013-10-31 16:08:29,917 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken from client DFSClient_1457307213
2013-10-31 16:08:29,918 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken is closed by DFSClient_1457307213
2013-10-31 16:08:29,923 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken
2013-10-31 16:08:29,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:08:29,928 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54377, bytes: 187, op: HDFS_READ, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1713806174407033772_1097, duration: 367584
2013-10-31 16:08:29,929 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0009 = 19. Number of splits = 5
2013-10-31 16:08:29,929 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,930 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,930 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,930 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,930 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,931 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,931 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,931 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,931 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,932 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,932 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,932 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,932 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,933 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,933 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,933 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0009 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:08:29,934 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0009 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:08:30,194 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-407226121447423998_1095 to datanode(s) 127.0.0.1:38271
2013-10-31 16:08:30,194 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_6292824092672117012_1092
2013-10-31 16:08:30,194 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_6292824092672117012_1092
2013-10-31 16:08:30,911 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-407226121447423998_1095 to 127.0.0.1:38271 
2013-10-31 16:08:30,913 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-407226121447423998_1095 src: /127.0.0.1:34343 dest: /127.0.0.1:38271
2013-10-31 16:08:30,913 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-407226121447423998_1095 to /127.0.0.1:38271
2013-10-31 16:08:30,917 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-407226121447423998_1095 src: /127.0.0.1:34343 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:08:30,918 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-407226121447423998_1095 size 238055
2013-10-31 16:08:31,408 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0009_m_000006_0' to tip task_20131031160444934_0009_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:08:31,416 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:08:31,417 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000006_0 which needs 1 slots
2013-10-31 16:08:31,417 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000006_0 which needs 1 slots
2013-10-31 16:08:31,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken	dst=null	perm=null
2013-10-31 16:08:31,426 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34344, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3766954078002236334_1101, duration: 295764
2013-10-31 16:08:31,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml	dst=null	perm=null
2013-10-31 16:08:31,436 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54382, bytes: 28781, op: HDFS_READ, cliID: DFSClient_1701655578, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3851144484951187398_1098, duration: 383880
2013-10-31 16:08:31,464 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:31,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar	dst=null	perm=null
2013-10-31 16:08:31,498 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47380, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1701655578, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-407226121447423998_1095, duration: 1620652
2013-10-31 16:08:31,591 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_-825662118
2013-10-31 16:08:31,592 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_-825662118 spawned.
2013-10-31 16:08:31,593 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000006_0/taskjvm.sh
2013-10-31 16:08:32,699 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6292824092672117012_1092 file build/test/data/dfs/data/data1/current/blk_6292824092672117012 for deletion
2013-10-31 16:08:32,699 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6292824092672117012_1092 at file build/test/data/dfs/data/data1/current/blk_6292824092672117012
2013-10-31 16:08:32,899 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-825662118 given task: attempt_20131031160444934_0009_m_000006_0
2013-10-31 16:08:32,901 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6292824092672117012_1092 file build/test/data/dfs/data/data7/current/blk_6292824092672117012 for deletion
2013-10-31 16:08:32,902 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6292824092672117012_1092 at file build/test/data/dfs/data/data7/current/blk_6292824092672117012
2013-10-31 16:08:33,194 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_6292824092672117012_1092
2013-10-31 16:08:33,404 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0008
2013-10-31 16:08:33,405 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0008_m_000005_0 not found in cache
2013-10-31 16:08:33,406 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0008 for user-log deletion with retainTimeStamp:1383322113406
2013-10-31 16:08:33,406 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0008
2013-10-31 16:08:33,407 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0008
2013-10-31 16:08:33,407 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0008 for user-log deletion with retainTimeStamp:1383322113407
2013-10-31 16:08:33,407 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0008 for user-log deletion with retainTimeStamp:1383322113407
2013-10-31 16:08:33,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:33,528 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_1494613078 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,539 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14300 with signal TERM. Exit code 0
2013-10-31 16:08:33,548 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_-1041693586 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,559 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14360 with signal TERM. Exit code 0
2013-10-31 16:08:33,560 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_-1761742138 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,574 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14361 with signal TERM. Exit code 0
2013-10-31 16:08:33,612 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_2020654016 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,617 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14157 with signal TERM. Exit code 0
2013-10-31 16:08:33,758 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,758 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,758 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:33,758 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_1494613078 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:33,773 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,773 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,773 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:33,773 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_-1761742138 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:33,781 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,781 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,781 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:33,781 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_-1041693586 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:33,790 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,791 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,791 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:33,791 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_2020654016 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:08:33,795 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_r_331271179 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,801 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14553 with signal TERM. Exit code 0
2013-10-31 16:08:33,911 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6292824092672117012_1092 file build/test/data/dfs/data/data6/current/blk_6292824092672117012 for deletion
2013-10-31 16:08:33,912 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6292824092672117012_1092 at file build/test/data/dfs/data/data6/current/blk_6292824092672117012
2013-10-31 16:08:33,973 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,973 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,973 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:33,973 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_r_331271179 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:34,173 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_1814522490 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:34,183 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14301 with signal TERM. Exit code 0
2013-10-31 16:08:34,357 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:34,357 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:34,357 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:34,358 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_1814522490 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:08:36,349 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000006_0 0.0% setup
2013-10-31 16:08:36,352 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000006_0 is done.
2013-10-31 16:08:36,353 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000006_0  was -1
2013-10-31 16:08:36,353 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:37,423 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000006_0' has completed task_20131031160444934_0009_m_000006 successfully.
2013-10-31 16:08:37,483 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000000_0' to tip task_20131031160444934_0009_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:08:37,485 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000000
2013-10-31 16:08:37,486 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000001_0' to tip task_20131031160444934_0009_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:08:37,486 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000001
2013-10-31 16:08:37,488 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000002_0' to tip task_20131031160444934_0009_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:08:37,488 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000002
2013-10-31 16:08:37,489 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:08:37,489 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000003_0' to tip task_20131031160444934_0009_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:08:37,490 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:08:37,491 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000003
2013-10-31 16:08:37,491 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000000_0 which needs 1 slots
2013-10-31 16:08:37,491 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000000_0 which needs 1 slots
2013-10-31 16:08:37,491 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000001_0 which needs 1 slots
2013-10-31 16:08:37,492 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000004_0' to tip task_20131031160444934_0009_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:37,492 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0009_m_000001_0 which needs 1 slots
2013-10-31 16:08:37,493 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:08:37,493 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000004
2013-10-31 16:08:37,497 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:08:37,498 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000002_0 which needs 1 slots
2013-10-31 16:08:37,501 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000002_0 which needs 1 slots
2013-10-31 16:08:37,504 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:08:37,504 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000004_0 which needs 1 slots
2013-10-31 16:08:37,504 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000003_0 which needs 1 slots
2013-10-31 16:08:37,504 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000004_0 which needs 1 slots
2013-10-31 16:08:37,504 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0009_m_000003_0 which needs 1 slots
2013-10-31 16:08:37,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken	dst=null	perm=null
2013-10-31 16:08:37,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken	dst=null	perm=null
2013-10-31 16:08:37,543 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_-1184700124
2013-10-31 16:08:37,543 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_-1184700124 spawned.
2013-10-31 16:08:37,544 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0009/attempt_20131031160444934_0009_m_000000_0. Attempting to reuse: jvm_20131031160444934_0009_m_-825662118
2013-10-31 16:08:37,545 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47386, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3766954078002236334_1101, duration: 136935
2013-10-31 16:08:37,545 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000001_0/taskjvm.sh
2013-10-31 16:08:37,545 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54390, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3766954078002236334_1101, duration: 134511
2013-10-31 16:08:37,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml	dst=null	perm=null
2013-10-31 16:08:37,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml	dst=null	perm=null
2013-10-31 16:08:37,551 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34288, bytes: 28781, op: HDFS_READ, cliID: DFSClient_189942969, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3851144484951187398_1098, duration: 220711
2013-10-31 16:08:37,551 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34289, bytes: 28781, op: HDFS_READ, cliID: DFSClient_-1789704205, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3851144484951187398_1098, duration: 161963
2013-10-31 16:08:37,576 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:37,576 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:37,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar	dst=null	perm=null
2013-10-31 16:08:37,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar	dst=null	perm=null
2013-10-31 16:08:37,592 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34359, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1789704205, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-407226121447423998_1095, duration: 694885
2013-10-31 16:08:37,592 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54396, bytes: 239915, op: HDFS_READ, cliID: DFSClient_189942969, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-407226121447423998_1095, duration: 689540
2013-10-31 16:08:37,653 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_-2002516500
2013-10-31 16:08:37,654 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_-2002516500 spawned.
2013-10-31 16:08:37,654 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_-1792548309
2013-10-31 16:08:37,654 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_1533201895
2013-10-31 16:08:37,655 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_-1792548309 spawned.
2013-10-31 16:08:37,655 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_1533201895 spawned.
2013-10-31 16:08:37,656 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000003_0/taskjvm.sh
2013-10-31 16:08:37,656 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000002_0/taskjvm.sh
2013-10-31 16:08:37,657 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000004_0/taskjvm.sh
2013-10-31 16:08:37,906 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-825662118 given task: attempt_20131031160444934_0009_m_000000_0
2013-10-31 16:08:38,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split	dst=null	perm=null
2013-10-31 16:08:38,174 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34363, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4549843032236031964_1096, duration: 170304
2013-10-31 16:08:38,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:38,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:38,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:38,348 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-1184700124 given task: attempt_20131031160444934_0009_m_000001_0
2013-10-31 16:08:38,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:38,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:38,501 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34295, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 143748
2013-10-31 16:08:38,504 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47398, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 105184
2013-10-31 16:08:38,511 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000. blk_-5291005561899941657_1102
2013-10-31 16:08:38,527 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5291005561899941657_1102 src: /127.0.0.1:34366 dest: /127.0.0.1:38271
2013-10-31 16:08:38,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5291005561899941657_1102 src: /127.0.0.1:47400 dest: /127.0.0.1:47311
2013-10-31 16:08:38,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5291005561899941657_1102 src: /127.0.0.1:34299 dest: /127.0.0.1:50942
2013-10-31 16:08:38,531 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34299, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5291005561899941657_1102, duration: 1391446
2013-10-31 16:08:38,531 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5291005561899941657_1102 terminating
2013-10-31 16:08:38,531 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47400, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5291005561899941657_1102, duration: 1852436
2013-10-31 16:08:38,531 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5291005561899941657_1102 terminating
2013-10-31 16:08:38,532 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34366, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5291005561899941657_1102, duration: 2227336
2013-10-31 16:08:38,532 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5291005561899941657_1102 terminating
2013-10-31 16:08:38,533 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5291005561899941657_1102 size 104
2013-10-31 16:08:38,534 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0009_m_000000_0
2013-10-31 16:08:38,535 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0009_m_000000_0
2013-10-31 16:08:38,535 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5291005561899941657_1102 size 104
2013-10-31 16:08:38,535 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5291005561899941657_1102 size 104
2013-10-31 16:08:38,575 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:38,576 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000000_0 0.0% 
2013-10-31 16:08:38,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split	dst=null	perm=null
2013-10-31 16:08:38,855 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54409, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4549843032236031964_1096, duration: 170943
2013-10-31 16:08:38,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:38,895 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47407, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 144543
2013-10-31 16:08:38,901 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-2002516500 given task: attempt_20131031160444934_0009_m_000003_0
2013-10-31 16:08:38,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:38,930 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_1533201895 given task: attempt_20131031160444934_0009_m_000002_0
2013-10-31 16:08:38,930 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-1792548309 given task: attempt_20131031160444934_0009_m_000004_0
2013-10-31 16:08:38,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:39,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:39,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:39,155 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47408, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 177456
2013-10-31 16:08:39,165 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001. blk_-5838032444424121691_1103
2013-10-31 16:08:39,189 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5838032444424121691_1103 src: /127.0.0.1:47409 dest: /127.0.0.1:47311
2013-10-31 16:08:39,190 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5838032444424121691_1103 src: /127.0.0.1:54413 dest: /127.0.0.1:41648
2013-10-31 16:08:39,191 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5838032444424121691_1103 src: /127.0.0.1:34309 dest: /127.0.0.1:50942
2013-10-31 16:08:39,193 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34309, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5838032444424121691_1103, duration: 1198143
2013-10-31 16:08:39,193 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5838032444424121691_1103 terminating
2013-10-31 16:08:39,193 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54413, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5838032444424121691_1103, duration: 1581933
2013-10-31 16:08:39,194 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5838032444424121691_1103 terminating
2013-10-31 16:08:39,194 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47409, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5838032444424121691_1103, duration: 1929748
2013-10-31 16:08:39,194 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5838032444424121691_1103 size 104
2013-10-31 16:08:39,194 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5838032444424121691_1103 terminating
2013-10-31 16:08:39,194 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5838032444424121691_1103 size 104
2013-10-31 16:08:39,195 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0009_m_000001_0
2013-10-31 16:08:39,196 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0009_m_000001_0
2013-10-31 16:08:39,197 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5838032444424121691_1103 size 104
2013-10-31 16:08:39,249 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:39,250 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000001_0 0.0% 
2013-10-31 16:08:39,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split	dst=null	perm=null
2013-10-31 16:08:39,408 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54418, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4549843032236031964_1096, duration: 170049
2013-10-31 16:08:39,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split	dst=null	perm=null
2013-10-31 16:08:39,442 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34314, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4549843032236031964_1096, duration: 155233
2013-10-31 16:08:39,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split	dst=null	perm=null
2013-10-31 16:08:39,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:39,447 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47417, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 105391
2013-10-31 16:08:39,450 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47418, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4549843032236031964_1096, duration: 142082
2013-10-31 16:08:39,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:39,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:39,481 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47419, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 117374
2013-10-31 16:08:39,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:39,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:08:39,489 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34318, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 114582
2013-10-31 16:08:39,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:39,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:39,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:39,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:39,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:39,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47421, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 147204
2013-10-31 16:08:39,802 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003. blk_-5304158798441442397_1106
2013-10-31 16:08:39,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:39,824 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5304158798441442397_1106 src: /127.0.0.1:54425 dest: /127.0.0.1:41648
2013-10-31 16:08:39,825 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5304158798441442397_1106 src: /127.0.0.1:34321 dest: /127.0.0.1:50942
2013-10-31 16:08:39,826 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5304158798441442397_1106 src: /127.0.0.1:34391 dest: /127.0.0.1:38271
2013-10-31 16:08:39,828 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34391, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5304158798441442397_1106, duration: 1011020
2013-10-31 16:08:39,829 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5304158798441442397_1106 terminating
2013-10-31 16:08:39,829 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34321, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5304158798441442397_1106, duration: 1393764
2013-10-31 16:08:39,829 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5304158798441442397_1106 terminating
2013-10-31 16:08:39,829 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54425, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5304158798441442397_1106, duration: 1813531
2013-10-31 16:08:39,829 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5304158798441442397_1106 terminating
2013-10-31 16:08:39,831 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5304158798441442397_1106 size 104
2013-10-31 16:08:39,832 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5304158798441442397_1106 size 104
2013-10-31 16:08:39,833 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5304158798441442397_1106 size 104
2013-10-31 16:08:39,840 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:08:39,846 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,851 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,857 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,868 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,875 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,875 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:08:39,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:39,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:39,975 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47425, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 146172
2013-10-31 16:08:39,984 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002. blk_-4584120486602198512_1106
2013-10-31 16:08:40,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4584120486602198512_1106 src: /127.0.0.1:34324 dest: /127.0.0.1:50942
2013-10-31 16:08:40,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4584120486602198512_1106 src: /127.0.0.1:54430 dest: /127.0.0.1:41648
2013-10-31 16:08:40,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4584120486602198512_1106 src: /127.0.0.1:47428 dest: /127.0.0.1:47311
2013-10-31 16:08:40,011 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47428, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4584120486602198512_1106, duration: 1015031
2013-10-31 16:08:40,011 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4584120486602198512_1106 terminating
2013-10-31 16:08:40,011 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54430, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4584120486602198512_1106, duration: 1360524
2013-10-31 16:08:40,012 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4584120486602198512_1106 terminating
2013-10-31 16:08:40,012 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34324, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4584120486602198512_1106, duration: 1742258
2013-10-31 16:08:40,012 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4584120486602198512_1106 terminating
2013-10-31 16:08:40,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4584120486602198512_1106 size 104
2013-10-31 16:08:40,013 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4584120486602198512_1106 size 104
2013-10-31 16:08:40,013 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0009_m_000002_0
2013-10-31 16:08:40,013 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0009_m_000002_0
2013-10-31 16:08:40,015 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4584120486602198512_1106 size 104
2013-10-31 16:08:40,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:40,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:08:40,039 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47429, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 111811
2013-10-31 16:08:40,049 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004. blk_-4846897092815297308_1106
2013-10-31 16:08:40,058 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:40,058 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000002_0 0.0% 
2013-10-31 16:08:40,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4846897092815297308_1106 src: /127.0.0.1:34328 dest: /127.0.0.1:50942
2013-10-31 16:08:40,072 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4846897092815297308_1106 src: /127.0.0.1:47431 dest: /127.0.0.1:47311
2013-10-31 16:08:40,073 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4846897092815297308_1106 src: /127.0.0.1:34399 dest: /127.0.0.1:38271
2013-10-31 16:08:40,075 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34399, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4846897092815297308_1106, duration: 1586555
2013-10-31 16:08:40,075 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4846897092815297308_1106 terminating
2013-10-31 16:08:40,076 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47431, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4846897092815297308_1106, duration: 1531972
2013-10-31 16:08:40,076 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4846897092815297308_1106 terminating
2013-10-31 16:08:40,076 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4846897092815297308_1106 size 104
2013-10-31 16:08:40,077 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34328, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4846897092815297308_1106, duration: 2368776
2013-10-31 16:08:40,077 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4846897092815297308_1106 terminating
2013-10-31 16:08:40,078 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0009_m_000004_0
2013-10-31 16:08:40,078 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0009_m_000004_0
2013-10-31 16:08:40,079 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4846897092815297308_1106 size 104
2013-10-31 16:08:40,080 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4846897092815297308_1106 size 104
2013-10-31 16:08:40,140 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:40,141 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000004_0 0.0% 
2013-10-31 16:08:40,231 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0009_m_000003_0
2013-10-31 16:08:40,232 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0009_m_000003_0
2013-10-31 16:08:40,300 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:40,300 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000003_0 0.0% 
2013-10-31 16:08:40,495 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000000_0
2013-10-31 16:08:40,495 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000001_0
2013-10-31 16:08:40,497 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000002_0
2013-10-31 16:08:40,498 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000003_0
2013-10-31 16:08:40,505 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000004_0
2013-10-31 16:08:40,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0	dst=null	perm=null
2013-10-31 16:08:40,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:40,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:40,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0	dst=null	perm=null
2013-10-31 16:08:41,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0	dst=null	perm=null
2013-10-31 16:08:41,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:41,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:41,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0	dst=null	perm=null
2013-10-31 16:08:41,139 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:08:41,141 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000000_0 is done.
2013-10-31 16:08:41,141 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000000_0  was -1
2013-10-31 16:08:41,141 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:08:41,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0	dst=null	perm=null
2013-10-31 16:08:41,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:41,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004	dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:41,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0	dst=null	perm=null
2013-10-31 16:08:41,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0	dst=null	perm=null
2013-10-31 16:08:41,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:41,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:41,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0	dst=null	perm=null
2013-10-31 16:08:41,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0	dst=null	perm=null
2013-10-31 16:08:41,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:41,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:41,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0	dst=null	perm=null
2013-10-31 16:08:41,776 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:08:41,778 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000001_0 is done.
2013-10-31 16:08:41,778 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000001_0  was -1
2013-10-31 16:08:41,778 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:42,334 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:08:42,336 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000003_0 is done.
2013-10-31 16:08:42,336 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000003_0  was -1
2013-10-31 16:08:42,337 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:08:42,371 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:08:42,372 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000002_0 is done.
2013-10-31 16:08:42,373 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000002_0  was -1
2013-10-31 16:08:42,373 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:42,376 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:08:42,377 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000004_0 is done.
2013-10-31 16:08:42,377 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000004_0  was -1
2013-10-31 16:08:42,377 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:42,491 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0009_m_000006_0
2013-10-31 16:08:42,491 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0009_m_000006_0
2013-10-31 16:08:42,491 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000006_0 not found in cache
2013-10-31 16:08:43,500 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000000_0' has completed task_20131031160444934_0009_m_000000 successfully.
2013-10-31 16:08:43,501 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000001_0' has completed task_20131031160444934_0009_m_000001 successfully.
2013-10-31 16:08:43,505 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000002_0' has completed task_20131031160444934_0009_m_000002 successfully.
2013-10-31 16:08:43,507 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000003_0' has completed task_20131031160444934_0009_m_000003 successfully.
2013-10-31 16:08:43,509 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000004_0' has completed task_20131031160444934_0009_m_000004 successfully.
2013-10-31 16:08:43,513 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0009_m_000005_0' to tip task_20131031160444934_0009_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:43,516 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:08:43,516 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000005_0 which needs 1 slots
2013-10-31 16:08:43,517 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000005_0 which needs 1 slots
2013-10-31 16:08:43,556 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_1873334364
2013-10-31 16:08:43,556 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_1873334364 spawned.
2013-10-31 16:08:43,559 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000005_0/taskjvm.sh
2013-10-31 16:08:45,471 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_1873334364 given task: attempt_20131031160444934_0009_m_000005_0
2013-10-31 16:08:45,969 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000005_0 0.0% 
2013-10-31 16:08:45,972 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 571 Total time for transactions(ms): 11Number of transactions batched in Syncs: 51 Number of syncs: 405 SyncTimes(ms): 13614 1883 
2013-10-31 16:08:47,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary	dst=null	perm=null
2013-10-31 16:08:47,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:47,058 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_SUCCESS from client DFSClient_attempt_20131031160444934_0009_m_000005_0
2013-10-31 16:08:47,058 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0009_m_000005_0
2013-10-31 16:08:47,066 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-407226121447423998 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:47,066 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-407226121447423998 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:47,067 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-407226121447423998 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:47,067 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-407226121447423998 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:47,067 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4549843032236031964 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:47,067 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4549843032236031964 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:47,067 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4549843032236031964 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:47,068 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4549843032236031964 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:47,068 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1713806174407033772 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:47,068 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1713806174407033772 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:47,068 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1713806174407033772 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:47,069 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3851144484951187398 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:47,069 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3851144484951187398 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:47,069 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3851144484951187398 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:47,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009	dst=null	perm=null
2013-10-31 16:08:48,197 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_3851144484951187398_1098 blk_4549843032236031964_1096 blk_-407226121447423998_1095
2013-10-31 16:08:48,197 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-1713806174407033772_1097 blk_4549843032236031964_1096 blk_-407226121447423998_1095
2013-10-31 16:08:48,901 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000005_0 0.0% cleanup
2013-10-31 16:08:48,902 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000005_0 is done.
2013-10-31 16:08:48,903 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000005_0  was -1
2013-10-31 16:08:48,903 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:49,821 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000005_0' has completed task_20131031160444934_0009_m_000005 successfully.
2013-10-31 16:08:50,421 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0009 has completed successfully.
2013-10-31 16:08:50,422 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0009,submitTime=1383235708780,launchTime=1383235709933,firstMapTaskLaunchTime=1383235717483,firstJobSetupTaskLaunchTime=1383235711408,firstJobCleanupTaskLaunchTime=1383235723513,finishTime=1383235730421,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2ACF4E5230894D15AF9BC4DFE6B54EB0/3821613F42004C66A17762F1A2881F4C] cogrouping/(2/2)
2013-10-31 16:08:50,428 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66. blk_5462009111682244982_1107
2013-10-31 16:08:50,430 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5462009111682244982_1107 src: /127.0.0.1:54439 dest: /127.0.0.1:41648
2013-10-31 16:08:50,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5462009111682244982_1107 src: /127.0.0.1:47437 dest: /127.0.0.1:47311
2013-10-31 16:08:50,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5462009111682244982_1107 src: /127.0.0.1:34336 dest: /127.0.0.1:50942
2013-10-31 16:08:50,439 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34336, dest: /127.0.0.1:50942, bytes: 26348, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5462009111682244982_1107, duration: 1641248
2013-10-31 16:08:50,439 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5462009111682244982_1107 terminating
2013-10-31 16:08:50,440 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47437, dest: /127.0.0.1:47311, bytes: 26348, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5462009111682244982_1107, duration: 3603203
2013-10-31 16:08:50,440 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5462009111682244982_1107 size 26348
2013-10-31 16:08:50,440 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54439, dest: /127.0.0.1:41648, bytes: 26348, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5462009111682244982_1107, duration: 3122251
2013-10-31 16:08:50,440 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5462009111682244982_1107 terminating
2013-10-31 16:08:50,441 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5462009111682244982_1107 terminating
2013-10-31 16:08:50,441 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5462009111682244982_1107 size 26348
2013-10-31 16:08:50,444 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66 from client DFSClient_1060990612
2013-10-31 16:08:50,445 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66 is closed by DFSClient_1060990612
2013-10-31 16:08:50,445 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5462009111682244982_1107 size 26348
2013-10-31 16:08:50,451 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:08:50,452 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000004_0'
2013-10-31 16:08:50,453 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3766954078002236334 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:50,453 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000005_0'
2013-10-31 16:08:50,453 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3766954078002236334 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:50,454 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3766954078002236334 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:50,454 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0009
2013-10-31 16:08:50,454 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0009 being deleted.
2013-10-31 16:08:50,457 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0009_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:08:50,458 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (1/2) ...tform/joinsintocogrouplhs
2013-10-31 16:08:50,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009	dst=null	perm=null
2013-10-31 16:08:50,464 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:08:50,464 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:08:50,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:50,705 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1713806174407033772_1097 file build/test/data/dfs/data/data1/current/blk_-1713806174407033772 for deletion
2013-10-31 16:08:50,705 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-407226121447423998_1095 file build/test/data/dfs/data/data2/current/blk_-407226121447423998 for deletion
2013-10-31 16:08:50,705 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1713806174407033772_1097 at file build/test/data/dfs/data/data1/current/blk_-1713806174407033772
2013-10-31 16:08:50,706 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4549843032236031964_1096 file build/test/data/dfs/data/data2/current/blk_4549843032236031964 for deletion
2013-10-31 16:08:50,706 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-407226121447423998_1095 at file build/test/data/dfs/data/data2/current/blk_-407226121447423998
2013-10-31 16:08:50,706 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4549843032236031964_1096 at file build/test/data/dfs/data/data2/current/blk_4549843032236031964
2013-10-31 16:08:50,907 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-407226121447423998_1095 file build/test/data/dfs/data/data7/current/blk_-407226121447423998 for deletion
2013-10-31 16:08:50,907 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3851144484951187398_1098 file build/test/data/dfs/data/data7/current/blk_3851144484951187398 for deletion
2013-10-31 16:08:50,907 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-407226121447423998_1095 at file build/test/data/dfs/data/data7/current/blk_-407226121447423998
2013-10-31 16:08:50,907 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4549843032236031964_1096 file build/test/data/dfs/data/data8/current/blk_4549843032236031964 for deletion
2013-10-31 16:08:50,908 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3851144484951187398_1098 at file build/test/data/dfs/data/data7/current/blk_3851144484951187398
2013-10-31 16:08:50,908 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4549843032236031964_1096 at file build/test/data/dfs/data/data8/current/blk_4549843032236031964
2013-10-31 16:08:51,198 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_3851144484951187398_1098 blk_3766954078002236334_1101 blk_-1713806174407033772_1097 blk_4549843032236031964_1096 blk_-407226121447423998_1095
2013-10-31 16:08:51,198 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_3851144484951187398_1098 blk_3766954078002236334_1101 blk_-1713806174407033772_1097 blk_4549843032236031964_1096 blk_-407226121447423998_1095
2013-10-31 16:08:51,305 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1713806174407033772_1097 file build/test/data/dfs/data/data4/current/blk_-1713806174407033772 for deletion
2013-10-31 16:08:51,305 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-407226121447423998_1095 file build/test/data/dfs/data/data4/current/blk_-407226121447423998 for deletion
2013-10-31 16:08:51,305 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1713806174407033772_1097 at file build/test/data/dfs/data/data4/current/blk_-1713806174407033772
2013-10-31 16:08:51,306 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3766954078002236334_1101 file build/test/data/dfs/data/data3/current/blk_3766954078002236334 for deletion
2013-10-31 16:08:51,306 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-407226121447423998_1095 at file build/test/data/dfs/data/data4/current/blk_-407226121447423998
2013-10-31 16:08:51,306 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3766954078002236334_1101 at file build/test/data/dfs/data/data3/current/blk_3766954078002236334
2013-10-31 16:08:51,306 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3851144484951187398_1098 file build/test/data/dfs/data/data3/current/blk_3851144484951187398 for deletion
2013-10-31 16:08:51,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4549843032236031964_1096 file build/test/data/dfs/data/data3/current/blk_4549843032236031964 for deletion
2013-10-31 16:08:51,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3851144484951187398_1098 at file build/test/data/dfs/data/data3/current/blk_3851144484951187398
2013-10-31 16:08:51,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4549843032236031964_1096 at file build/test/data/dfs/data/data3/current/blk_4549843032236031964
2013-10-31 16:08:51,918 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1713806174407033772_1097 file build/test/data/dfs/data/data5/current/blk_-1713806174407033772 for deletion
2013-10-31 16:08:51,918 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-407226121447423998_1095 file build/test/data/dfs/data/data5/current/blk_-407226121447423998 for deletion
2013-10-31 16:08:51,919 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1713806174407033772_1097 at file build/test/data/dfs/data/data5/current/blk_-1713806174407033772
2013-10-31 16:08:51,919 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3766954078002236334_1101 file build/test/data/dfs/data/data5/current/blk_3766954078002236334 for deletion
2013-10-31 16:08:51,919 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3851144484951187398_1098 file build/test/data/dfs/data/data6/current/blk_3851144484951187398 for deletion
2013-10-31 16:08:51,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-407226121447423998_1095 at file build/test/data/dfs/data/data5/current/blk_-407226121447423998
2013-10-31 16:08:51,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3851144484951187398_1098 at file build/test/data/dfs/data/data6/current/blk_3851144484951187398
2013-10-31 16:08:51,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4549843032236031964_1096 file build/test/data/dfs/data/data6/current/blk_4549843032236031964 for deletion
2013-10-31 16:08:51,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3766954078002236334_1101 at file build/test/data/dfs/data/data5/current/blk_3766954078002236334
2013-10-31 16:08:51,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4549843032236031964_1096 at file build/test/data/dfs/data/data6/current/blk_4549843032236031964
2013-10-31 16:08:52,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:08:52,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,177 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar. blk_-7275383232629599215_1108
2013-10-31 16:08:52,178 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275383232629599215_1108 src: /127.0.0.1:47440 dest: /127.0.0.1:47311
2013-10-31 16:08:52,180 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275383232629599215_1108 src: /127.0.0.1:34339 dest: /127.0.0.1:50942
2013-10-31 16:08:52,182 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275383232629599215_1108 src: /127.0.0.1:34409 dest: /127.0.0.1:38271
2013-10-31 16:08:52,190 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34409, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7275383232629599215_1108, duration: 4420288
2013-10-31 16:08:52,190 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7275383232629599215_1108 terminating
2013-10-31 16:08:52,191 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34339, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7275383232629599215_1108, duration: 5547344
2013-10-31 16:08:52,192 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7275383232629599215_1108 terminating
2013-10-31 16:08:52,192 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7275383232629599215_1108 size 238055
2013-10-31 16:08:52,192 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47440, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7275383232629599215_1108, duration: 6426505
2013-10-31 16:08:52,192 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7275383232629599215_1108 terminating
2013-10-31 16:08:52,194 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7275383232629599215_1108 size 238055
2013-10-31 16:08:52,195 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar from client DFSClient_1457307213
2013-10-31 16:08:52,195 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar is closed by DFSClient_1457307213
2013-10-31 16:08:52,196 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7275383232629599215_1108 size 238055
2013-10-31 16:08:52,203 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar. New replication is 10
2013-10-31 16:08:52,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar	dst=null	perm=null
2013-10-31 16:08:52,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,220 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:08:52,225 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:52,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:08:52,228 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:52,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:08:52,231 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:52,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:08:52,234 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:52,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:08:52,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,254 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split. New replication is 10
2013-10-31 16:08:52,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split	dst=null	perm=null
2013-10-31 16:08:52,264 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split. blk_5876356830892656538_1109
2013-10-31 16:08:52,266 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5876356830892656538_1109 src: /127.0.0.1:47443 dest: /127.0.0.1:47311
2013-10-31 16:08:52,267 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5876356830892656538_1109 src: /127.0.0.1:34342 dest: /127.0.0.1:50942
2013-10-31 16:08:52,268 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5876356830892656538_1109 src: /127.0.0.1:54448 dest: /127.0.0.1:41648
2013-10-31 16:08:52,270 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5876356830892656538_1109 src: /127.0.0.1:34413 dest: /127.0.0.1:38271
2013-10-31 16:08:52,272 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34413, dest: /127.0.0.1:38271, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5876356830892656538_1109, duration: 979664
2013-10-31 16:08:52,272 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5876356830892656538_1109 terminating
2013-10-31 16:08:52,273 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54448, dest: /127.0.0.1:41648, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5876356830892656538_1109, duration: 435139
2013-10-31 16:08:52,273 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5876356830892656538_1109 terminating
2013-10-31 16:08:52,274 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34342, dest: /127.0.0.1:50942, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5876356830892656538_1109, duration: 2208970
2013-10-31 16:08:52,274 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5876356830892656538_1109 terminating
2013-10-31 16:08:52,274 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47443, dest: /127.0.0.1:47311, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5876356830892656538_1109, duration: 1642149
2013-10-31 16:08:52,274 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5876356830892656538_1109 size 1722
2013-10-31 16:08:52,274 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_5876356830892656538_1109 terminating
2013-10-31 16:08:52,277 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5876356830892656538_1109 size 1722
2013-10-31 16:08:52,277 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split from client DFSClient_1457307213
2013-10-31 16:08:52,278 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split is closed by DFSClient_1457307213
2013-10-31 16:08:52,278 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5876356830892656538_1109 size 1722
2013-10-31 16:08:52,278 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5876356830892656538_1109 size 1722
2013-10-31 16:08:52,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,301 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo. blk_2593862758334192524_1110
2013-10-31 16:08:52,303 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2593862758334192524_1110 src: /127.0.0.1:34345 dest: /127.0.0.1:50942
2013-10-31 16:08:52,304 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2593862758334192524_1110 src: /127.0.0.1:54451 dest: /127.0.0.1:41648
2013-10-31 16:08:52,305 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2593862758334192524_1110 src: /127.0.0.1:47449 dest: /127.0.0.1:47311
2013-10-31 16:08:52,308 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47449, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2593862758334192524_1110, duration: 66531
2013-10-31 16:08:52,308 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2593862758334192524_1110 terminating
2013-10-31 16:08:52,308 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54451, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2593862758334192524_1110, duration: 797784
2013-10-31 16:08:52,309 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2593862758334192524_1110 terminating
2013-10-31 16:08:52,309 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34345, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2593862758334192524_1110, duration: 1632381
2013-10-31 16:08:52,309 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2593862758334192524_1110 size 183
2013-10-31 16:08:52,310 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2593862758334192524_1110 terminating
2013-10-31 16:08:52,311 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2593862758334192524_1110 size 183
2013-10-31 16:08:52,316 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:08:52,316 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:08:52,316 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2593862758334192524_1110 size 183
2013-10-31 16:08:52,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,346 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml. blk_-83841722562286388_1111
2013-10-31 16:08:52,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-83841722562286388_1111 src: /127.0.0.1:34348 dest: /127.0.0.1:50942
2013-10-31 16:08:52,349 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-83841722562286388_1111 src: /127.0.0.1:47451 dest: /127.0.0.1:47311
2013-10-31 16:08:52,351 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-83841722562286388_1111 src: /127.0.0.1:54455 dest: /127.0.0.1:41648
2013-10-31 16:08:52,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54455, dest: /127.0.0.1:41648, bytes: 29836, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-83841722562286388_1111, duration: 258515
2013-10-31 16:08:52,354 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-83841722562286388_1111 terminating
2013-10-31 16:08:52,355 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47451, dest: /127.0.0.1:47311, bytes: 29836, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-83841722562286388_1111, duration: 1048790
2013-10-31 16:08:52,355 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-83841722562286388_1111 terminating
2013-10-31 16:08:52,355 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-83841722562286388_1111 size 29836
2013-10-31 16:08:52,356 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34348, dest: /127.0.0.1:50942, bytes: 29836, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-83841722562286388_1111, duration: 2001229
2013-10-31 16:08:52,356 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-83841722562286388_1111 size 29836
2013-10-31 16:08:52,356 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-83841722562286388_1111 terminating
2013-10-31 16:08:52,358 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml from client DFSClient_1457307213
2013-10-31 16:08:52,358 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml is closed by DFSClient_1457307213
2013-10-31 16:08:52,360 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-83841722562286388_1111 size 29836
2013-10-31 16:08:52,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml	dst=null	perm=null
2013-10-31 16:08:52,376 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54457, bytes: 30072, op: HDFS_READ, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-83841722562286388_1111, duration: 397366
2013-10-31 16:08:52,393 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0010: nMaps=5 nReduces=1 max=-1
2013-10-31 16:08:52,394 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0010 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:08:52,394 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0010	RESULT=SUCCESS
2013-10-31 16:08:52,394 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0010
2013-10-31 16:08:52,394 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0010
2013-10-31 16:08:52,395 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0010
2013-10-31 16:08:52,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,427 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_conf.xml. blk_-7595975142248415961_1113
2013-10-31 16:08:52,429 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7595975142248415961_1113 src: /127.0.0.1:47455 dest: /127.0.0.1:47311
2013-10-31 16:08:52,431 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7595975142248415961_1113 src: /127.0.0.1:34423 dest: /127.0.0.1:38271
2013-10-31 16:08:52,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7595975142248415961_1113 src: /127.0.0.1:54460 dest: /127.0.0.1:41648
2013-10-31 16:08:52,437 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54460, dest: /127.0.0.1:41648, bytes: 29901, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7595975142248415961_1113, duration: 1181329
2013-10-31 16:08:52,437 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7595975142248415961_1113 terminating
2013-10-31 16:08:52,437 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34423, dest: /127.0.0.1:38271, bytes: 29901, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7595975142248415961_1113, duration: 1859085
2013-10-31 16:08:52,438 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7595975142248415961_1113 terminating
2013-10-31 16:08:52,438 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47455, dest: /127.0.0.1:47311, bytes: 29901, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7595975142248415961_1113, duration: 2269501
2013-10-31 16:08:52,439 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7595975142248415961_1113 terminating
2013-10-31 16:08:52,441 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7595975142248415961_1113 size 29901
2013-10-31 16:08:52,442 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7595975142248415961_1113 size 29901
2013-10-31 16:08:52,443 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7595975142248415961_1113 size 29901
2013-10-31 16:08:52,514 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000000_0'
2013-10-31 16:08:52,514 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000001_0'
2013-10-31 16:08:52,514 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000006_0'
2013-10-31 16:08:52,518 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000002_0'
2013-10-31 16:08:52,518 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000003_0'
2013-10-31 16:08:52,841 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_conf.xml from client DFSClient_1820866866
2013-10-31 16:08:52,842 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_conf.xml is closed by DFSClient_1820866866
2013-10-31 16:08:53,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:53,378 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken. blk_1633528743412317819_1114
2013-10-31 16:08:53,380 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1633528743412317819_1114 src: /127.0.0.1:34356 dest: /127.0.0.1:50942
2013-10-31 16:08:53,381 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1633528743412317819_1114 src: /127.0.0.1:54462 dest: /127.0.0.1:41648
2013-10-31 16:08:53,383 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1633528743412317819_1114 src: /127.0.0.1:34427 dest: /127.0.0.1:38271
2013-10-31 16:08:53,386 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34427, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1633528743412317819_1114, duration: 90703
2013-10-31 16:08:53,386 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1633528743412317819_1114 terminating
2013-10-31 16:08:53,386 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1633528743412317819_1114 size 116
2013-10-31 16:08:53,387 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54462, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1633528743412317819_1114, duration: 973980
2013-10-31 16:08:53,387 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1633528743412317819_1114 terminating
2013-10-31 16:08:53,388 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34356, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1633528743412317819_1114, duration: 2128318
2013-10-31 16:08:53,388 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1633528743412317819_1114 terminating
2013-10-31 16:08:53,390 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken from client DFSClient_1457307213
2013-10-31 16:08:53,391 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken is closed by DFSClient_1457307213
2013-10-31 16:08:53,391 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1633528743412317819_1114 size 116
2013-10-31 16:08:53,392 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1633528743412317819_1114 size 116
2013-10-31 16:08:53,398 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken
2013-10-31 16:08:53,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:08:53,402 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47461, bytes: 187, op: HDFS_READ, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2593862758334192524_1110, duration: 275515
2013-10-31 16:08:53,404 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0010 = 103. Number of splits = 5
2013-10-31 16:08:53,404 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,404 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,404 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,405 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,405 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,405 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,405 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,406 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,406 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,406 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,406 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,407 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,407 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,407 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,407 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,408 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0010 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:08:53,408 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0010 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:08:53,475 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0010_m_000006_0' to tip task_20131031160444934_0010_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:53,488 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:08:53,488 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000006_0 which needs 1 slots
2013-10-31 16:08:53,491 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000006_0 which needs 1 slots
2013-10-31 16:08:53,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken	dst=null	perm=null
2013-10-31 16:08:53,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54465, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1633528743412317819_1114, duration: 302011
2013-10-31 16:08:53,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml	dst=null	perm=null
2013-10-31 16:08:53,509 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54467, bytes: 30072, op: HDFS_READ, cliID: DFSClient_2117278007, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-83841722562286388_1111, duration: 386580
2013-10-31 16:08:53,541 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:53,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar	dst=null	perm=null
2013-10-31 16:08:53,566 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34432, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2117278007, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7275383232629599215_1108, duration: 1350968
2013-10-31 16:08:53,676 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0009_m_1873334364
2013-10-31 16:08:53,683 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15257 with signal TERM. Exit code 0
2013-10-31 16:08:53,683 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_103663412
2013-10-31 16:08:53,684 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_103663412 spawned.
2013-10-31 16:08:53,685 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000006_0/taskjvm.sh
2013-10-31 16:08:53,971 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0009_m_1873334364
2013-10-31 16:08:54,199 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-7275383232629599215_1108 to datanode(s) 127.0.0.1:41648
2013-10-31 16:08:54,199 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_3766954078002236334_1101
2013-10-31 16:08:54,289 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:54,290 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:54,290 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:54,290 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_1873334364 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:54,918 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_103663412 given task: attempt_20131031160444934_0010_m_000006_0
2013-10-31 16:08:55,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:55,454 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0009
2013-10-31 16:08:55,454 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000004_0 not found in cache
2013-10-31 16:08:55,454 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000005_0 not found in cache
2013-10-31 16:08:55,455 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0009 for user-log deletion with retainTimeStamp:1383322135454
2013-10-31 16:08:56,428 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_-1792548309 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:56,441 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15019 with signal TERM. Exit code 0
2013-10-31 16:08:56,648 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:56,648 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:56,649 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:56,650 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_-1792548309 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:56,707 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-7275383232629599215_1108 to 127.0.0.1:41648 
2013-10-31 16:08:56,707 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3766954078002236334_1101 file build/test/data/dfs/data/data1/current/blk_3766954078002236334 for deletion
2013-10-31 16:08:56,708 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3766954078002236334_1101 at file build/test/data/dfs/data/data1/current/blk_3766954078002236334
2013-10-31 16:08:56,709 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275383232629599215_1108 src: /127.0.0.1:54472 dest: /127.0.0.1:41648
2013-10-31 16:08:56,709 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-7275383232629599215_1108 to /127.0.0.1:41648
2013-10-31 16:08:56,712 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-7275383232629599215_1108 src: /127.0.0.1:54472 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:08:56,715 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7275383232629599215_1108 size 238055
2013-10-31 16:08:57,515 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0009
2013-10-31 16:08:57,515 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000000_0 not found in cache
2013-10-31 16:08:57,516 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000001_0 not found in cache
2013-10-31 16:08:57,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0009 for user-log deletion with retainTimeStamp:1383322137516
2013-10-31 16:08:57,519 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0009
2013-10-31 16:08:57,519 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000003_0 not found in cache
2013-10-31 16:08:57,520 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000002_0 not found in cache
2013-10-31 16:08:57,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0009 for user-log deletion with retainTimeStamp:1383322137520
2013-10-31 16:08:57,911 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_-2002516500 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:57,920 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14987 with signal TERM. Exit code 0
2013-10-31 16:08:57,927 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_1533201895 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:57,937 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15020 with signal TERM. Exit code 0
2013-10-31 16:08:58,114 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:58,114 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:58,114 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:58,115 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_-2002516500 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:58,116 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:58,116 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:58,116 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:58,116 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_1533201895 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:58,189 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_-825662118 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:58,198 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14753 with signal TERM. Exit code 0
2013-10-31 16:08:58,333 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000006_0 0.0% setup
2013-10-31 16:08:58,335 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000006_0 is done.
2013-10-31 16:08:58,335 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000006_0  was -1
2013-10-31 16:08:58,335 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:58,379 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:58,379 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:58,379 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:58,379 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_-825662118 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:08:58,866 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_-1184700124 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:58,874 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14919 with signal TERM. Exit code 0
2013-10-31 16:08:59,138 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:59,139 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:59,139 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:08:59,140 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_-1184700124 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:59,493 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000006_0' has completed task_20131031160444934_0010_m_000006 successfully.
2013-10-31 16:08:59,497 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000000_0' to tip task_20131031160444934_0010_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:59,498 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000000
2013-10-31 16:08:59,498 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000001_0' to tip task_20131031160444934_0010_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:59,499 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000001
2013-10-31 16:08:59,501 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000002_0' to tip task_20131031160444934_0010_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:59,502 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:08:59,502 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000002
2013-10-31 16:08:59,503 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:08:59,503 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000003_0' to tip task_20131031160444934_0010_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:59,503 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000000_0 which needs 1 slots
2013-10-31 16:08:59,503 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000000_0 which needs 1 slots
2013-10-31 16:08:59,504 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000003
2013-10-31 16:08:59,504 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000001_0 which needs 1 slots
2013-10-31 16:08:59,504 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0010_m_000001_0 which needs 1 slots
2013-10-31 16:08:59,508 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:08:59,512 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:08:59,512 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000002_0 which needs 1 slots
2013-10-31 16:08:59,513 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000002_0 which needs 1 slots
2013-10-31 16:08:59,514 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000003_0 which needs 1 slots
2013-10-31 16:08:59,514 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0010_m_000003_0 which needs 1 slots
2013-10-31 16:08:59,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken	dst=null	perm=null
2013-10-31 16:08:59,523 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54473, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1633528743412317819_1114, duration: 294267
2013-10-31 16:08:59,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml	dst=null	perm=null
2013-10-31 16:08:59,534 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54475, bytes: 30072, op: HDFS_READ, cliID: DFSClient_1700631364, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-83841722562286388_1111, duration: 380486
2013-10-31 16:08:59,542 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_970588561
2013-10-31 16:08:59,543 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_970588561 spawned.
2013-10-31 16:08:59,544 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0010/attempt_20131031160444934_0010_m_000001_0. Attempting to reuse: jvm_20131031160444934_0010_m_103663412
2013-10-31 16:08:59,544 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000000_0/taskjvm.sh
2013-10-31 16:08:59,624 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:59,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar	dst=null	perm=null
2013-10-31 16:08:59,685 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47473, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1700631364, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7275383232629599215_1108, duration: 1645563
2013-10-31 16:08:59,759 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_2036878026
2013-10-31 16:08:59,759 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_2036878026 spawned.
2013-10-31 16:08:59,761 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000002_0/taskjvm.sh
2013-10-31 16:08:59,762 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_-1794027183
2013-10-31 16:08:59,763 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_-1794027183 spawned.
2013-10-31 16:08:59,764 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000003_0/taskjvm.sh
2013-10-31 16:08:59,893 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_103663412 given task: attempt_20131031160444934_0010_m_000001_0
2013-10-31 16:09:00,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split	dst=null	perm=null
2013-10-31 16:09:00,009 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47475, bytes: 1738, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5876356830892656538_1109, duration: 174744
2013-10-31 16:09:00,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:09:00,061 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34443, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 125649
2013-10-31 16:09:00,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43	dst=null	perm=null
2013-10-31 16:09:00,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000	dst=null	perm=null
2013-10-31 16:09:00,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001	dst=null	perm=null
2013-10-31 16:09:00,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002	dst=null	perm=null
2013-10-31 16:09:00,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003	dst=null	perm=null
2013-10-31 16:09:00,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004	dst=null	perm=null
2013-10-31 16:09:00,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000	dst=null	perm=null
2013-10-31 16:09:00,382 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47478, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5291005561899941657_1102, duration: 134344
2013-10-31 16:09:00,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001	dst=null	perm=null
2013-10-31 16:09:00,390 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47479, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5838032444424121691_1103, duration: 133794
2013-10-31 16:09:00,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002	dst=null	perm=null
2013-10-31 16:09:00,394 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34378, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4584120486602198512_1106, duration: 103685
2013-10-31 16:09:00,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003	dst=null	perm=null
2013-10-31 16:09:00,396 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54484, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5304158798441442397_1106, duration: 100605
2013-10-31 16:09:00,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004	dst=null	perm=null
2013-10-31 16:09:00,399 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34449, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4846897092815297308_1106, duration: 100665
2013-10-31 16:09:00,444 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_970588561 given task: attempt_20131031160444934_0010_m_000000_0
2013-10-31 16:09:00,823 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_2036878026 given task: attempt_20131031160444934_0010_m_000002_0
2013-10-31 16:09:00,896 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_-1794027183 given task: attempt_20131031160444934_0010_m_000003_0
2013-10-31 16:09:00,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split	dst=null	perm=null
2013-10-31 16:09:00,955 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47487, bytes: 1738, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5876356830892656538_1109, duration: 168077
2013-10-31 16:09:00,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:09:01,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43	dst=null	perm=null
2013-10-31 16:09:01,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000	dst=null	perm=null
2013-10-31 16:09:01,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001	dst=null	perm=null
2013-10-31 16:09:01,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002	dst=null	perm=null
2013-10-31 16:09:01,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003	dst=null	perm=null
2013-10-31 16:09:01,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004	dst=null	perm=null
2013-10-31 16:09:01,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000	dst=null	perm=null
2013-10-31 16:09:01,317 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47489, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5291005561899941657_1102, duration: 125372
2013-10-31 16:09:01,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001	dst=null	perm=null
2013-10-31 16:09:01,328 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54493, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5838032444424121691_1103, duration: 130146
2013-10-31 16:09:01,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002	dst=null	perm=null
2013-10-31 16:09:01,333 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34389, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4584120486602198512_1106, duration: 97322
2013-10-31 16:09:01,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003	dst=null	perm=null
2013-10-31 16:09:01,337 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54495, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5304158798441442397_1106, duration: 112011
2013-10-31 16:09:01,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004	dst=null	perm=null
2013-10-31 16:09:01,342 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34391, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4846897092815297308_1106, duration: 101440
2013-10-31 16:09:01,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54497, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 101923
2013-10-31 16:09:01,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split	dst=null	perm=null
2013-10-31 16:09:01,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34463, bytes: 1222, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5876356830892656538_1109, duration: 156919
2013-10-31 16:09:01,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:09:01,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split	dst=null	perm=null
2013-10-31 16:09:01,456 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34395, bytes: 706, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5876356830892656538_1109, duration: 184573
2013-10-31 16:09:01,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:09:01,496 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47498, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 123991
2013-10-31 16:09:01,523 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000004_0' to tip task_20131031160444934_0010_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:09:01,524 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000004
2013-10-31 16:09:01,526 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:09:01,526 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000004_0 which needs 1 slots
2013-10-31 16:09:01,526 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000004_0 which needs 1 slots
2013-10-31 16:09:01,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken	dst=null	perm=null
2013-10-31 16:09:01,530 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34397, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1633528743412317819_1114, duration: 116591
2013-10-31 16:09:01,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml	dst=null	perm=null
2013-10-31 16:09:01,534 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47501, bytes: 30072, op: HDFS_READ, cliID: DFSClient_-893266544, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-83841722562286388_1111, duration: 155537
2013-10-31 16:09:01,547 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:01,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar	dst=null	perm=null
2013-10-31 16:09:01,562 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34469, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-893266544, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7275383232629599215_1108, duration: 665040
2013-10-31 16:09:01,615 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_-616353992
2013-10-31 16:09:01,616 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_-616353992 spawned.
2013-10-31 16:09:01,617 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000004_0/taskjvm.sh
2013-10-31 16:09:02,297 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34470, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 130998
2013-10-31 16:09:02,971 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+26
2013-10-31 16:09:02,973 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000001_0 is done.
2013-10-31 16:09:02,974 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000001_0  was 264
2013-10-31 16:09:02,974 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:09:03,135 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_-616353992 given task: attempt_20131031160444934_0010_m_000004_0
2013-10-31 16:09:03,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split	dst=null	perm=null
2013-10-31 16:09:03,648 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34473, bytes: 706, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5876356830892656538_1109, duration: 164221
2013-10-31 16:09:03,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:09:03,689 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54510, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 245942
2013-10-31 16:09:03,879 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+26
2013-10-31 16:09:03,880 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000000_0 is done.
2013-10-31 16:09:03,881 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000000_0  was 307
2013-10-31 16:09:03,881 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:04,302 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:0+17
2013-10-31 16:09:04,305 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000002_0 is done.
2013-10-31 16:09:04,305 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000002_0  was 101
2013-10-31 16:09:04,305 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:09:04,382 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:17+17
2013-10-31 16:09:04,384 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000003_0 is done.
2013-10-31 16:09:04,384 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000003_0  was 82
2013-10-31 16:09:04,385 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:04,503 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0010_m_000006_0
2013-10-31 16:09:04,504 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0010_m_000006_0
2013-10-31 16:09:04,504 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0010_m_000006_0 not found in cache
2013-10-31 16:09:05,508 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000000_0' has completed task_20131031160444934_0010_m_000000 successfully.
2013-10-31 16:09:05,510 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000001_0' has completed task_20131031160444934_0010_m_000001 successfully.
2013-10-31 16:09:05,512 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0010_r_000000_0' to tip task_20131031160444934_0010_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:09:05,514 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:09:05,515 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_r_000000_0 which needs 1 slots
2013-10-31 16:09:05,515 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_r_000000_0 which needs 1 slots
2013-10-31 16:09:05,515 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000002_0' has completed task_20131031160444934_0010_m_000002 successfully.
2013-10-31 16:09:05,519 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000003_0' has completed task_20131031160444934_0010_m_000003 successfully.
2013-10-31 16:09:05,554 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_r_266027598
2013-10-31 16:09:05,555 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_r_266027598 spawned.
2013-10-31 16:09:05,558 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_r_000000_0/taskjvm.sh
2013-10-31 16:09:06,553 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:34+17
2013-10-31 16:09:06,557 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000004_0 is done.
2013-10-31 16:09:06,557 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000004_0  was 82
2013-10-31 16:09:06,557 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:06,733 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_r_266027598 given task: attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:07,532 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000004_0' has completed task_20131031160444934_0010_m_000004 successfully.
2013-10-31 16:09:12,422 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:47008, bytes: 307, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000000_0, duration: 9460221
2013-10-31 16:09:12,447 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:47008, bytes: 264, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000001_0, duration: 11572434
2013-10-31 16:09:12,465 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42336, bytes: 101, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000002_0, duration: 12379117
2013-10-31 16:09:12,480 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42336, bytes: 82, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000003_0, duration: 11451142
2013-10-31 16:09:12,501 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46203, bytes: 82, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000004_0, duration: 15473339
2013-10-31 16:09:13,221 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:09:13,285 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:09:13,348 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:09:13,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:13,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:13,608 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000. blk_3690515878603194838_1115
2013-10-31 16:09:13,631 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3690515878603194838_1115 src: /127.0.0.1:47513 dest: /127.0.0.1:47311
2013-10-31 16:09:13,632 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3690515878603194838_1115 src: /127.0.0.1:54517 dest: /127.0.0.1:41648
2013-10-31 16:09:13,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3690515878603194838_1115 src: /127.0.0.1:34482 dest: /127.0.0.1:38271
2013-10-31 16:09:13,636 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34482, dest: /127.0.0.1:38271, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0010_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3690515878603194838_1115, duration: 2088814
2013-10-31 16:09:13,636 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3690515878603194838_1115 terminating
2013-10-31 16:09:13,636 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3690515878603194838_1115 size 592
2013-10-31 16:09:13,636 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54517, dest: /127.0.0.1:41648, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0010_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3690515878603194838_1115, duration: 2756664
2013-10-31 16:09:13,637 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3690515878603194838_1115 terminating
2013-10-31 16:09:13,637 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47513, dest: /127.0.0.1:47311, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0010_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3690515878603194838_1115, duration: 3199784
2013-10-31 16:09:13,637 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3690515878603194838_1115 size 592
2013-10-31 16:09:13,637 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3690515878603194838_1115 terminating
2013-10-31 16:09:13,638 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3690515878603194838_1115 size 592
2013-10-31 16:09:13,640 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:13,640 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:13,678 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0010_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:13,678 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:09:14,524 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031160444934_0010_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:09:14,528 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:14,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0	dst=null	perm=null
2013-10-31 16:09:14,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:14,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:14,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0	dst=null	perm=null
2013-10-31 16:09:16,275 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 1.0% reduce > reduce
2013-10-31 16:09:16,278 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 1.0% reduce > reduce
2013-10-31 16:09:16,279 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_r_000000_0 is done.
2013-10-31 16:09:16,279 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_r_000000_0  was -1
2013-10-31 16:09:16,280 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:17,532 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_r_000000_0' has completed task_20131031160444934_0010_r_000000 successfully.
2013-10-31 16:09:17,537 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0010_m_000005_0' to tip task_20131031160444934_0010_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:09:17,540 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:09:17,541 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000005_0 which needs 1 slots
2013-10-31 16:09:17,541 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000005_0 which needs 1 slots
2013-10-31 16:09:17,579 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0010/attempt_20131031160444934_0010_m_000005_0. Attempting to reuse: jvm_20131031160444934_0010_m_970588561
2013-10-31 16:09:17,954 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_970588561 given task: attempt_20131031160444934_0010_m_000005_0
2013-10-31 16:09:18,065 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000005_0 0.0% 
2013-10-31 16:09:18,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary	dst=null	perm=null
2013-10-31 16:09:18,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:18,091 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS from client DFSClient_attempt_20131031160444934_0010_m_000005_0
2013-10-31 16:09:18,091 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0010_m_000005_0
2013-10-31 16:09:18,099 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275383232629599215 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:18,099 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275383232629599215 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:18,100 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275383232629599215 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:18,100 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275383232629599215 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:18,100 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5876356830892656538 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:18,100 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5876356830892656538 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:18,101 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5876356830892656538 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:18,101 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5876356830892656538 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:18,101 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2593862758334192524 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:18,101 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2593862758334192524 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:18,101 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2593862758334192524 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:18,102 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-83841722562286388 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:18,102 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-83841722562286388 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:18,102 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-83841722562286388 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:18,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010	dst=null	perm=null
2013-10-31 16:09:18,203 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_5876356830892656538_1109 blk_2593862758334192524_1110 blk_-83841722562286388_1111 blk_-7275383232629599215_1108
2013-10-31 16:09:18,203 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_5876356830892656538_1109 blk_2593862758334192524_1110 blk_-83841722562286388_1111 blk_-7275383232629599215_1108
2013-10-31 16:09:18,314 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275383232629599215_1108 file build/test/data/dfs/data/data3/current/blk_-7275383232629599215 for deletion
2013-10-31 16:09:18,315 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-83841722562286388_1111 file build/test/data/dfs/data/data4/current/blk_-83841722562286388 for deletion
2013-10-31 16:09:18,315 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2593862758334192524_1110 file build/test/data/dfs/data/data3/current/blk_2593862758334192524 for deletion
2013-10-31 16:09:18,315 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-83841722562286388_1111 at file build/test/data/dfs/data/data4/current/blk_-83841722562286388
2013-10-31 16:09:18,316 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5876356830892656538_1109 file build/test/data/dfs/data/data4/current/blk_5876356830892656538 for deletion
2013-10-31 16:09:18,315 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275383232629599215_1108 at file build/test/data/dfs/data/data3/current/blk_-7275383232629599215
2013-10-31 16:09:18,316 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5876356830892656538_1109 at file build/test/data/dfs/data/data4/current/blk_5876356830892656538
2013-10-31 16:09:18,316 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2593862758334192524_1110 at file build/test/data/dfs/data/data3/current/blk_2593862758334192524
2013-10-31 16:09:18,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275383232629599215_1108 file build/test/data/dfs/data/data5/current/blk_-7275383232629599215 for deletion
2013-10-31 16:09:18,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-83841722562286388_1111 file build/test/data/dfs/data/data6/current/blk_-83841722562286388 for deletion
2013-10-31 16:09:18,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275383232629599215_1108 at file build/test/data/dfs/data/data5/current/blk_-7275383232629599215
2013-10-31 16:09:18,928 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-83841722562286388_1111 at file build/test/data/dfs/data/data6/current/blk_-83841722562286388
2013-10-31 16:09:18,928 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2593862758334192524_1110 file build/test/data/dfs/data/data5/current/blk_2593862758334192524 for deletion
2013-10-31 16:09:18,928 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5876356830892656538_1109 file build/test/data/dfs/data/data6/current/blk_5876356830892656538 for deletion
2013-10-31 16:09:18,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2593862758334192524_1110 at file build/test/data/dfs/data/data5/current/blk_2593862758334192524
2013-10-31 16:09:18,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5876356830892656538_1109 at file build/test/data/dfs/data/data6/current/blk_5876356830892656538
2013-10-31 16:09:20,010 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 40
2013-10-31 16:09:21,039 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000005_0 0.0% cleanup
2013-10-31 16:09:21,040 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000005_0 is done.
2013-10-31 16:09:21,041 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000005_0  was -1
2013-10-31 16:09:21,041 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:21,204 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_5876356830892656538_1109 blk_2593862758334192524_1110 blk_-83841722562286388_1111 blk_-7275383232629599215_1108
2013-10-31 16:09:21,204 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_5876356830892656538_1109 blk_-7275383232629599215_1108
2013-10-31 16:09:22,541 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:22,541 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:23,548 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000005_0' has completed task_20131031160444934_0010_m_000005 successfully.
2013-10-31 16:09:23,550 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0010 has completed successfully.
2013-10-31 16:09:23,550 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0010,submitTime=1383235732366,launchTime=1383235733408,firstMapTaskLaunchTime=1383235739496,firstReduceTaskLaunchTime=1383235745512,firstJobSetupTaskLaunchTime=1383235733474,firstJobCleanupTaskLaunchTime=1383235757537,finishTime=1383235763550,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2ACF4E5230894D15AF9BC4DFE6B54EB0/B8A324B82B1040EBAE8BAFDA029C9493] cogrouping/(1/2) ...tform/joinsintocogrouplhs
2013-10-31 16:09:23,556 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB. blk_6690545113843447823_1116
2013-10-31 16:09:23,558 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6690545113843447823_1116 src: /127.0.0.1:54524 dest: /127.0.0.1:41648
2013-10-31 16:09:23,561 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6690545113843447823_1116 src: /127.0.0.1:34420 dest: /127.0.0.1:50942
2013-10-31 16:09:23,564 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6690545113843447823_1116 src: /127.0.0.1:34490 dest: /127.0.0.1:38271
2013-10-31 16:09:23,567 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34490, dest: /127.0.0.1:38271, bytes: 32049, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6690545113843447823_1116, duration: 319389
2013-10-31 16:09:23,568 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6690545113843447823_1116 terminating
2013-10-31 16:09:23,568 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34420, dest: /127.0.0.1:50942, bytes: 32049, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6690545113843447823_1116, duration: 1135902
2013-10-31 16:09:23,569 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6690545113843447823_1116 terminating
2013-10-31 16:09:23,569 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54524, dest: /127.0.0.1:41648, bytes: 32049, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6690545113843447823_1116, duration: 2266858
2013-10-31 16:09:23,570 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6690545113843447823_1116 terminating
2013-10-31 16:09:23,571 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6690545113843447823_1116 size 32049
2013-10-31 16:09:23,573 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6690545113843447823_1116 size 32049
2013-10-31 16:09:23,573 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB from client DFSClient_1820866866
2013-10-31 16:09:23,574 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB is closed by DFSClient_1820866866
2013-10-31 16:09:23,574 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6690545113843447823_1116 size 32049
2013-10-31 16:09:23,581 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:09:23,582 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000000_0'
2013-10-31 16:09:23,582 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000001_0'
2013-10-31 16:09:23,583 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000005_0'
2013-10-31 16:09:23,583 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000006_0'
2013-10-31 16:09:23,584 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1633528743412317819 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,584 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_r_000000_0'
2013-10-31 16:09:23,584 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1633528743412317819 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1633528743412317819 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,587 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0010_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:09:23,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010	dst=null	perm=null
2013-10-31 16:09:23,592 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5462009111682244982 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,592 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5462009111682244982 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,592 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5462009111682244982 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,593 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1737899946981776145 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,593 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1737899946981776145 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,593 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1737899946981776145 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,593 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5291005561899941657 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,593 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5291005561899941657 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,594 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5291005561899941657 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,594 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5838032444424121691 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,594 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5838032444424121691 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,594 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5838032444424121691 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,595 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4584120486602198512 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,595 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4584120486602198512 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,595 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4584120486602198512 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,595 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5304158798441442397 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,596 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5304158798441442397 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,596 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5304158798441442397 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,596 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4846897092815297308 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,596 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4846897092815297308 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,596 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4846897092815297308 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43	dst=null	perm=null
2013-10-31 16:09:23,604 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary
2013-10-31 16:09:23,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2013-10-31 16:09:23,625 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:23,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2013-10-31 16:09:23,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2013-10-31 16:09:23,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34492, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3690515878603194838_1115, duration: 426305
2013-10-31 16:09:23,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2013-10-31 16:09:23,652 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:23,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2013-10-31 16:09:23,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2013-10-31 16:09:23,656 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34493, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3690515878603194838_1115, duration: 406926
2013-10-31 16:09:23,657 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintocogrouplhs
2013-10-31 16:09:23,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2013-10-31 16:09:23,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2013-10-31 16:09:23,662 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34494, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3690515878603194838_1115, duration: 427386
2013-10-31 16:09:23,673 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:09:23,674 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:09:23,707 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting
2013-10-31 16:09:23,707 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:09:23,707 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:09:23,708 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:09:23,708 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:09:23,709 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs"]
2013-10-31 16:09:23,709 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  parallel execution is enabled: true
2013-10-31 16:09:23,709 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  starting jobs: 2
2013-10-31 16:09:23,709 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  allocating threads: 2
2013-10-31 16:09:23,711 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (2/2)
2013-10-31 16:09:23,715 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:09:23,715 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:09:23,715 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275383232629599215_1108 file build/test/data/dfs/data/data2/current/blk_-7275383232629599215 for deletion
2013-10-31 16:09:23,715 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5876356830892656538_1109 file build/test/data/dfs/data/data1/current/blk_5876356830892656538 for deletion
2013-10-31 16:09:23,715 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275383232629599215_1108 at file build/test/data/dfs/data/data2/current/blk_-7275383232629599215
2013-10-31 16:09:23,715 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5876356830892656538_1109 at file build/test/data/dfs/data/data1/current/blk_5876356830892656538
2013-10-31 16:09:23,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:23,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:09:23,918 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275383232629599215_1108 file build/test/data/dfs/data/data7/current/blk_-7275383232629599215 for deletion
2013-10-31 16:09:23,918 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-83841722562286388_1111 file build/test/data/dfs/data/data8/current/blk_-83841722562286388 for deletion
2013-10-31 16:09:23,918 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275383232629599215_1108 at file build/test/data/dfs/data/data7/current/blk_-7275383232629599215
2013-10-31 16:09:23,919 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-83841722562286388_1111 at file build/test/data/dfs/data/data8/current/blk_-83841722562286388
2013-10-31 16:09:23,918 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2593862758334192524_1110 file build/test/data/dfs/data/data7/current/blk_2593862758334192524 for deletion
2013-10-31 16:09:23,919 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5876356830892656538_1109 file build/test/data/dfs/data/data8/current/blk_5876356830892656538 for deletion
2013-10-31 16:09:23,919 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2593862758334192524_1110 at file build/test/data/dfs/data/data7/current/blk_2593862758334192524
2013-10-31 16:09:23,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5876356830892656538_1109 at file build/test/data/dfs/data/data8/current/blk_5876356830892656538
2013-10-31 16:09:24,204 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-5304158798441442397_1106 blk_-4584120486602198512_1106 blk_-5838032444424121691_1103 blk_5462009111682244982_1107 blk_1633528743412317819_1114
2013-10-31 16:09:24,205 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-4846897092815297308_1106 blk_1737899946981776145_1100 blk_-5291005561899941657_1102 blk_-4584120486602198512_1106 blk_-5838032444424121691_1103 blk_5462009111682244982_1107
2013-10-31 16:09:24,316 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5838032444424121691_1103 file build/test/data/dfs/data/data3/current/blk_-5838032444424121691 for deletion
2013-10-31 16:09:24,316 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5291005561899941657_1102 file build/test/data/dfs/data/data4/current/blk_-5291005561899941657 for deletion
2013-10-31 16:09:24,316 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5838032444424121691_1103 at file build/test/data/dfs/data/data3/current/blk_-5838032444424121691
2013-10-31 16:09:24,316 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4846897092815297308_1106 file build/test/data/dfs/data/data3/current/blk_-4846897092815297308 for deletion
2013-10-31 16:09:24,316 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5291005561899941657_1102 at file build/test/data/dfs/data/data4/current/blk_-5291005561899941657
2013-10-31 16:09:24,317 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4584120486602198512_1106 file build/test/data/dfs/data/data4/current/blk_-4584120486602198512 for deletion
2013-10-31 16:09:24,317 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4846897092815297308_1106 at file build/test/data/dfs/data/data3/current/blk_-4846897092815297308
2013-10-31 16:09:24,317 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1737899946981776145_1100 file build/test/data/dfs/data/data4/current/blk_1737899946981776145 for deletion
2013-10-31 16:09:24,317 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4584120486602198512_1106 at file build/test/data/dfs/data/data4/current/blk_-4584120486602198512
2013-10-31 16:09:24,318 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5462009111682244982_1107 file build/test/data/dfs/data/data4/current/blk_5462009111682244982 for deletion
2013-10-31 16:09:24,318 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1737899946981776145_1100 at file build/test/data/dfs/data/data4/current/blk_1737899946981776145
2013-10-31 16:09:24,318 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5462009111682244982_1107 at file build/test/data/dfs/data/data4/current/blk_5462009111682244982
2013-10-31 16:09:24,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,719 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar. blk_1251994781094396070_1117
2013-10-31 16:09:24,721 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1251994781094396070_1117 src: /127.0.0.1:47528 dest: /127.0.0.1:47311
2013-10-31 16:09:24,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1251994781094396070_1117 src: /127.0.0.1:34496 dest: /127.0.0.1:38271
2013-10-31 16:09:24,724 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1251994781094396070_1117 src: /127.0.0.1:54533 dest: /127.0.0.1:41648
2013-10-31 16:09:24,735 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54533, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1251994781094396070_1117, duration: 7331696
2013-10-31 16:09:24,735 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1251994781094396070_1117 terminating
2013-10-31 16:09:24,736 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34496, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1251994781094396070_1117, duration: 8457384
2013-10-31 16:09:24,736 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1251994781094396070_1117 size 238055
2013-10-31 16:09:24,736 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1251994781094396070_1117 terminating
2013-10-31 16:09:24,737 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47528, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1251994781094396070_1117, duration: 9279602
2013-10-31 16:09:24,737 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1251994781094396070_1117 terminating
2013-10-31 16:09:24,737 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1251994781094396070_1117 size 238055
2013-10-31 16:09:24,739 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar from client DFSClient_1457307213
2013-10-31 16:09:24,740 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar is closed by DFSClient_1457307213
2013-10-31 16:09:24,740 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1251994781094396070_1117 size 238055
2013-10-31 16:09:24,746 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar. New replication is 10
2013-10-31 16:09:24,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar	dst=null	perm=null
2013-10-31 16:09:24,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,758 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:09:24,763 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:24,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:09:24,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,777 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split. New replication is 10
2013-10-31 16:09:24,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split	dst=null	perm=null
2013-10-31 16:09:24,784 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split. blk_-2068202829203503883_1118
2013-10-31 16:09:24,785 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2068202829203503883_1118 src: /127.0.0.1:47531 dest: /127.0.0.1:47311
2013-10-31 16:09:24,787 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2068202829203503883_1118 src: /127.0.0.1:34430 dest: /127.0.0.1:50942
2013-10-31 16:09:24,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2068202829203503883_1118 src: /127.0.0.1:54536 dest: /127.0.0.1:41648
2013-10-31 16:09:24,790 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2068202829203503883_1118 src: /127.0.0.1:34501 dest: /127.0.0.1:38271
2013-10-31 16:09:24,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34501, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2068202829203503883_1118, duration: 113249
2013-10-31 16:09:24,793 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2068202829203503883_1118 terminating
2013-10-31 16:09:24,794 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54536, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2068202829203503883_1118, duration: 937556
2013-10-31 16:09:24,795 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2068202829203503883_1118 terminating
2013-10-31 16:09:24,795 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2068202829203503883_1118 size 1732
2013-10-31 16:09:24,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34430, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2068202829203503883_1118, duration: 2096866
2013-10-31 16:09:24,796 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2068202829203503883_1118 terminating
2013-10-31 16:09:24,796 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47531, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2068202829203503883_1118, duration: 3145532
2013-10-31 16:09:24,797 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2068202829203503883_1118 size 1732
2013-10-31 16:09:24,797 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2068202829203503883_1118 terminating
2013-10-31 16:09:24,803 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2068202829203503883_1118 size 1732
2013-10-31 16:09:24,803 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split from client DFSClient_1457307213
2013-10-31 16:09:24,804 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split is closed by DFSClient_1457307213
2013-10-31 16:09:24,804 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2068202829203503883_1118 size 1732
2013-10-31 16:09:24,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,830 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo. blk_-5329221742438129426_1119
2013-10-31 16:09:24,832 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5329221742438129426_1119 src: /127.0.0.1:47535 dest: /127.0.0.1:47311
2013-10-31 16:09:24,833 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5329221742438129426_1119 src: /127.0.0.1:54539 dest: /127.0.0.1:41648
2013-10-31 16:09:24,835 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5329221742438129426_1119 src: /127.0.0.1:34504 dest: /127.0.0.1:38271
2013-10-31 16:09:24,838 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34504, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5329221742438129426_1119, duration: 65758
2013-10-31 16:09:24,838 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5329221742438129426_1119 terminating
2013-10-31 16:09:24,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54539, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5329221742438129426_1119, duration: 834017
2013-10-31 16:09:24,839 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5329221742438129426_1119 terminating
2013-10-31 16:09:24,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47535, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5329221742438129426_1119, duration: 1696844
2013-10-31 16:09:24,840 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5329221742438129426_1119 terminating
2013-10-31 16:09:24,843 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5329221742438129426_1119 size 183
2013-10-31 16:09:24,843 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:09:24,843 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:09:24,844 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5329221742438129426_1119 size 183
2013-10-31 16:09:24,844 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5329221742438129426_1119 size 183
2013-10-31 16:09:24,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,871 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml. blk_-2920999921881403397_1120
2013-10-31 16:09:24,873 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2920999921881403397_1120 src: /127.0.0.1:34436 dest: /127.0.0.1:50942
2013-10-31 16:09:24,875 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2920999921881403397_1120 src: /127.0.0.1:54542 dest: /127.0.0.1:41648
2013-10-31 16:09:24,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2920999921881403397_1120 src: /127.0.0.1:34507 dest: /127.0.0.1:38271
2013-10-31 16:09:24,880 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34507, dest: /127.0.0.1:38271, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2920999921881403397_1120, duration: 159608
2013-10-31 16:09:24,880 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2920999921881403397_1120 terminating
2013-10-31 16:09:24,881 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54542, dest: /127.0.0.1:41648, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2920999921881403397_1120, duration: 990403
2013-10-31 16:09:24,881 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2920999921881403397_1120 terminating
2013-10-31 16:09:24,882 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34436, dest: /127.0.0.1:50942, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2920999921881403397_1120, duration: 1872973
2013-10-31 16:09:24,882 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2920999921881403397_1120 terminating
2013-10-31 16:09:24,885 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2920999921881403397_1120 size 28557
2013-10-31 16:09:24,885 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml from client DFSClient_1457307213
2013-10-31 16:09:24,886 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml is closed by DFSClient_1457307213
2013-10-31 16:09:24,886 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2920999921881403397_1120 size 28557
2013-10-31 16:09:24,887 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2920999921881403397_1120 size 28557
2013-10-31 16:09:24,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml	dst=null	perm=null
2013-10-31 16:09:24,902 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54545, bytes: 28781, op: HDFS_READ, cliID: DFSClient_400949537, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2920999921881403397_1120, duration: 393111
2013-10-31 16:09:24,921 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0011: nMaps=5 nReduces=0 max=-1
2013-10-31 16:09:24,921 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0011 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:09:24,921 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0011
2013-10-31 16:09:24,921 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0011	RESULT=SUCCESS
2013-10-31 16:09:24,922 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0011
2013-10-31 16:09:24,924 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0011
2013-10-31 16:09:24,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5838032444424121691_1103 file build/test/data/dfs/data/data6/current/blk_-5838032444424121691 for deletion
2013-10-31 16:09:24,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5304158798441442397_1106 file build/test/data/dfs/data/data5/current/blk_-5304158798441442397 for deletion
2013-10-31 16:09:24,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5838032444424121691_1103 at file build/test/data/dfs/data/data6/current/blk_-5838032444424121691
2013-10-31 16:09:24,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4584120486602198512_1106 file build/test/data/dfs/data/data6/current/blk_-4584120486602198512 for deletion
2013-10-31 16:09:24,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5304158798441442397_1106 at file build/test/data/dfs/data/data5/current/blk_-5304158798441442397
2013-10-31 16:09:24,930 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4584120486602198512_1106 at file build/test/data/dfs/data/data6/current/blk_-4584120486602198512
2013-10-31 16:09:24,930 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1633528743412317819_1114 file build/test/data/dfs/data/data6/current/blk_1633528743412317819 for deletion
2013-10-31 16:09:24,931 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5462009111682244982_1107 file build/test/data/dfs/data/data5/current/blk_5462009111682244982 for deletion
2013-10-31 16:09:24,931 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1633528743412317819_1114 at file build/test/data/dfs/data/data6/current/blk_1633528743412317819
2013-10-31 16:09:24,931 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5462009111682244982_1107 at file build/test/data/dfs/data/data5/current/blk_5462009111682244982
2013-10-31 16:09:24,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,963 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_conf.xml. blk_-4432548704645493821_1122
2013-10-31 16:09:24,965 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4432548704645493821_1122 src: /127.0.0.1:34510 dest: /127.0.0.1:38271
2013-10-31 16:09:24,966 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4432548704645493821_1122 src: /127.0.0.1:54547 dest: /127.0.0.1:41648
2013-10-31 16:09:24,968 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4432548704645493821_1122 src: /127.0.0.1:34443 dest: /127.0.0.1:50942
2013-10-31 16:09:24,972 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34443, dest: /127.0.0.1:50942, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4432548704645493821_1122, duration: 481518
2013-10-31 16:09:24,973 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4432548704645493821_1122 terminating
2013-10-31 16:09:24,973 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54547, dest: /127.0.0.1:41648, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4432548704645493821_1122, duration: 2092644
2013-10-31 16:09:24,974 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4432548704645493821_1122 terminating
2013-10-31 16:09:24,974 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4432548704645493821_1122 size 28622
2013-10-31 16:09:24,974 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34510, dest: /127.0.0.1:38271, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4432548704645493821_1122, duration: 2142257
2013-10-31 16:09:24,975 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4432548704645493821_1122 terminating
2013-10-31 16:09:24,977 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4432548704645493821_1122 size 28622
2013-10-31 16:09:24,977 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_conf.xml from client DFSClient_400949537
2013-10-31 16:09:24,978 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_conf.xml is closed by DFSClient_400949537
2013-10-31 16:09:24,978 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4432548704645493821_1122 size 28622
2013-10-31 16:09:25,553 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000004_0'
2013-10-31 16:09:25,555 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0010
2013-10-31 16:09:25,555 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0010 being deleted.
2013-10-31 16:09:26,549 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000002_0'
2013-10-31 16:09:26,550 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000003_0'
2013-10-31 16:09:27,205 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_1251994781094396070_1117 to datanode(s) 127.0.0.1:50942
2013-10-31 16:09:27,206 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-4846897092815297308_1106 blk_1737899946981776145_1100 blk_-5291005561899941657_1102 blk_-5304158798441442397_1106 blk_-4584120486602198512_1106 blk_-5838032444424121691_1103 blk_5462009111682244982_1107 blk_1633528743412317819_1114
2013-10-31 16:09:27,206 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-4846897092815297308_1106 blk_1737899946981776145_1100 blk_-5291005561899941657_1102 blk_-5304158798441442397_1106 blk_1633528743412317819_1114
2013-10-31 16:09:27,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:27,437 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken. blk_8021674872422085597_1123
2013-10-31 16:09:27,439 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8021674872422085597_1123 src: /127.0.0.1:34444 dest: /127.0.0.1:50942
2013-10-31 16:09:27,441 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8021674872422085597_1123 src: /127.0.0.1:47547 dest: /127.0.0.1:47311
2013-10-31 16:09:27,443 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8021674872422085597_1123 src: /127.0.0.1:34515 dest: /127.0.0.1:38271
2013-10-31 16:09:27,445 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34515, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8021674872422085597_1123, duration: 69030
2013-10-31 16:09:27,446 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8021674872422085597_1123 terminating
2013-10-31 16:09:27,446 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8021674872422085597_1123 size 116
2013-10-31 16:09:27,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47547, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8021674872422085597_1123, duration: 841103
2013-10-31 16:09:27,447 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8021674872422085597_1123 terminating
2013-10-31 16:09:27,447 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34444, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8021674872422085597_1123, duration: 1749976
2013-10-31 16:09:27,448 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8021674872422085597_1123 terminating
2013-10-31 16:09:27,450 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8021674872422085597_1123 size 116
2013-10-31 16:09:27,450 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken from client DFSClient_1457307213
2013-10-31 16:09:27,451 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken is closed by DFSClient_1457307213
2013-10-31 16:09:27,451 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8021674872422085597_1123 size 116
2013-10-31 16:09:27,457 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken
2013-10-31 16:09:27,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:09:27,461 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47549, bytes: 187, op: HDFS_READ, cliID: DFSClient_400949537, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5329221742438129426_1119, duration: 275667
2013-10-31 16:09:27,463 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0011 = 19. Number of splits = 5
2013-10-31 16:09:27,463 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,463 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,465 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,465 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,465 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,465 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,466 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,466 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,466 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,466 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,467 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0011 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:09:27,467 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0011 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:09:27,929 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_1251994781094396070_1117 to 127.0.0.1:50942 
2013-10-31 16:09:27,932 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1251994781094396070_1117 src: /127.0.0.1:34448 dest: /127.0.0.1:50942
2013-10-31 16:09:27,932 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_1251994781094396070_1117 to /127.0.0.1:50942
2013-10-31 16:09:27,935 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1251994781094396070_1117 src: /127.0.0.1:34448 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:09:27,939 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1251994781094396070_1117 size 238055
2013-10-31 16:09:28,558 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0011_m_000006_0' to tip task_20131031160444934_0011_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:28,565 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:09:28,565 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000006_0 which needs 1 slots
2013-10-31 16:09:28,565 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000006_0 which needs 1 slots
2013-10-31 16:09:28,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken	dst=null	perm=null
2013-10-31 16:09:28,574 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34518, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8021674872422085597_1123, duration: 271270
2013-10-31 16:09:28,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml	dst=null	perm=null
2013-10-31 16:09:28,585 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34520, bytes: 28781, op: HDFS_READ, cliID: DFSClient_-77837723, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2920999921881403397_1120, duration: 381378
2013-10-31 16:09:28,585 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0010
2013-10-31 16:09:28,585 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0010_m_000005_0 not found in cache
2013-10-31 16:09:28,587 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0010 for user-log deletion with retainTimeStamp:1383322168587
2013-10-31 16:09:28,633 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:28,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar	dst=null	perm=null
2013-10-31 16:09:28,656 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34521, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-77837723, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1251994781094396070_1117, duration: 1450081
2013-10-31 16:09:28,754 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_-1944950700
2013-10-31 16:09:28,754 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_-1944950700 spawned.
2013-10-31 16:09:28,756 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000006_0/taskjvm.sh
2013-10-31 16:09:28,786 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_103663412 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:28,795 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15407 with signal TERM. Exit code 0
2013-10-31 16:09:28,824 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_r_266027598 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:28,833 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15865 with signal TERM. Exit code 0
2013-10-31 16:09:28,977 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:28,978 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:28,978 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:28,979 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_103663412 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:09:28,995 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:28,995 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:28,995 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:28,995 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_r_266027598 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:29,082 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_970588561 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:29,092 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15559 with signal TERM. Exit code 0
2013-10-31 16:09:29,300 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:29,300 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:29,300 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:29,300 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_970588561 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:09:29,717 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5304158798441442397_1106 file build/test/data/dfs/data/data2/current/blk_-5304158798441442397 for deletion
2013-10-31 16:09:29,717 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5291005561899941657_1102 file build/test/data/dfs/data/data1/current/blk_-5291005561899941657 for deletion
2013-10-31 16:09:29,717 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5304158798441442397_1106 at file build/test/data/dfs/data/data2/current/blk_-5304158798441442397
2013-10-31 16:09:29,717 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4846897092815297308_1106 file build/test/data/dfs/data/data1/current/blk_-4846897092815297308 for deletion
2013-10-31 16:09:29,718 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5291005561899941657_1102 at file build/test/data/dfs/data/data1/current/blk_-5291005561899941657
2013-10-31 16:09:29,718 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1633528743412317819_1114 file build/test/data/dfs/data/data1/current/blk_1633528743412317819 for deletion
2013-10-31 16:09:29,718 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4846897092815297308_1106 at file build/test/data/dfs/data/data1/current/blk_-4846897092815297308
2013-10-31 16:09:29,718 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1737899946981776145_1100 file build/test/data/dfs/data/data2/current/blk_1737899946981776145 for deletion
2013-10-31 16:09:29,718 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1633528743412317819_1114 at file build/test/data/dfs/data/data1/current/blk_1633528743412317819
2013-10-31 16:09:29,718 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1737899946981776145_1100 at file build/test/data/dfs/data/data2/current/blk_1737899946981776145
2013-10-31 16:09:29,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5838032444424121691_1103 file build/test/data/dfs/data/data8/current/blk_-5838032444424121691 for deletion
2013-10-31 16:09:29,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5304158798441442397_1106 file build/test/data/dfs/data/data7/current/blk_-5304158798441442397 for deletion
2013-10-31 16:09:29,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5838032444424121691_1103 at file build/test/data/dfs/data/data8/current/blk_-5838032444424121691
2013-10-31 16:09:29,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5291005561899941657_1102 file build/test/data/dfs/data/data7/current/blk_-5291005561899941657 for deletion
2013-10-31 16:09:29,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5304158798441442397_1106 at file build/test/data/dfs/data/data7/current/blk_-5304158798441442397
2013-10-31 16:09:29,921 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4846897092815297308_1106 file build/test/data/dfs/data/data7/current/blk_-4846897092815297308 for deletion
2013-10-31 16:09:29,921 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5291005561899941657_1102 at file build/test/data/dfs/data/data7/current/blk_-5291005561899941657
2013-10-31 16:09:29,921 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4584120486602198512_1106 file build/test/data/dfs/data/data8/current/blk_-4584120486602198512 for deletion
2013-10-31 16:09:29,921 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4846897092815297308_1106 at file build/test/data/dfs/data/data7/current/blk_-4846897092815297308
2013-10-31 16:09:29,921 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4584120486602198512_1106 at file build/test/data/dfs/data/data8/current/blk_-4584120486602198512
2013-10-31 16:09:29,921 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1633528743412317819_1114 file build/test/data/dfs/data/data7/current/blk_1633528743412317819 for deletion
2013-10-31 16:09:29,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1633528743412317819_1114 at file build/test/data/dfs/data/data7/current/blk_1633528743412317819
2013-10-31 16:09:29,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1737899946981776145_1100 file build/test/data/dfs/data/data8/current/blk_1737899946981776145 for deletion
2013-10-31 16:09:29,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1737899946981776145_1100 at file build/test/data/dfs/data/data8/current/blk_1737899946981776145
2013-10-31 16:09:29,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5462009111682244982_1107 file build/test/data/dfs/data/data8/current/blk_5462009111682244982 for deletion
2013-10-31 16:09:29,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5462009111682244982_1107 at file build/test/data/dfs/data/data8/current/blk_5462009111682244982
2013-10-31 16:09:30,112 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1944950700 given task: attempt_20131031160444934_0011_m_000006_0
2013-10-31 16:09:30,554 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0010
2013-10-31 16:09:30,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0010 for user-log deletion with retainTimeStamp:1383322170555
2013-10-31 16:09:30,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:31,131 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_-616353992 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:31,141 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15777 with signal TERM. Exit code 0
2013-10-31 16:09:31,354 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:31,354 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:31,354 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:31,354 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_-616353992 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:31,550 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0010
2013-10-31 16:09:31,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0010 for user-log deletion with retainTimeStamp:1383322171551
2013-10-31 16:09:31,895 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_2036878026 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:31,906 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15614 with signal TERM. Exit code 0
2013-10-31 16:09:31,976 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_-1794027183 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:31,981 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15649 with signal TERM. Exit code 0
2013-10-31 16:09:32,111 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:32,111 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:32,111 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:32,112 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_2036878026 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:32,163 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:32,163 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:32,163 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:32,163 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_-1794027183 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:33,548 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000006_0 0.0% setup
2013-10-31 16:09:33,551 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000006_0 is done.
2013-10-31 16:09:33,551 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000006_0  was -1
2013-10-31 16:09:33,552 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:34,571 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000006_0' has completed task_20131031160444934_0011_m_000006 successfully.
2013-10-31 16:09:34,703 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000000_0' to tip task_20131031160444934_0011_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:34,705 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000000
2013-10-31 16:09:34,705 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000001_0' to tip task_20131031160444934_0011_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:34,706 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000001
2013-10-31 16:09:34,708 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:09:34,709 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:09:34,709 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000000_0 which needs 1 slots
2013-10-31 16:09:34,709 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000000_0 which needs 1 slots
2013-10-31 16:09:34,710 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000001_0 which needs 1 slots
2013-10-31 16:09:34,710 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0011_m_000001_0 which needs 1 slots
2013-10-31 16:09:34,950 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_-1477786192
2013-10-31 16:09:34,951 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_-1477786192 spawned.
2013-10-31 16:09:34,953 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0011/attempt_20131031160444934_0011_m_000001_0. Attempting to reuse: jvm_20131031160444934_0011_m_-1944950700
2013-10-31 16:09:34,955 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000000_0/taskjvm.sh
2013-10-31 16:09:35,107 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1944950700 given task: attempt_20131031160444934_0011_m_000001_0
2013-10-31 16:09:35,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split	dst=null	perm=null
2013-10-31 16:09:35,212 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47562, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2068202829203503883_1118, duration: 166494
2013-10-31 16:09:35,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:09:35,252 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34461, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 125861
2013-10-31 16:09:35,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:35,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:35,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:35,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:35,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34462, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 147296
2013-10-31 16:09:35,535 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001. blk_-2376389404784738128_1124
2013-10-31 16:09:35,551 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2376389404784738128_1124 src: /127.0.0.1:47565 dest: /127.0.0.1:47311
2013-10-31 16:09:35,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2376389404784738128_1124 src: /127.0.0.1:34533 dest: /127.0.0.1:38271
2013-10-31 16:09:35,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2376389404784738128_1124 src: /127.0.0.1:34465 dest: /127.0.0.1:50942
2013-10-31 16:09:35,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34465, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2376389404784738128_1124, duration: 1123861
2013-10-31 16:09:35,555 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2376389404784738128_1124 terminating
2013-10-31 16:09:35,555 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2376389404784738128_1124 size 104
2013-10-31 16:09:35,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34533, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2376389404784738128_1124, duration: 1561459
2013-10-31 16:09:35,555 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2376389404784738128_1124 terminating
2013-10-31 16:09:35,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47565, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2376389404784738128_1124, duration: 1947201
2013-10-31 16:09:35,556 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2376389404784738128_1124 terminating
2013-10-31 16:09:35,557 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2376389404784738128_1124 size 104
2013-10-31 16:09:35,557 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0011_m_000001_0
2013-10-31 16:09:35,557 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0011_m_000001_0
2013-10-31 16:09:35,557 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2376389404784738128_1124 size 104
2013-10-31 16:09:35,559 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000002_0' to tip task_20131031160444934_0011_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:09:35,559 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000002
2013-10-31 16:09:35,559 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000003_0' to tip task_20131031160444934_0011_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:09:35,560 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000003
2013-10-31 16:09:35,560 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:09:35,561 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:09:35,561 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000002_0 which needs 1 slots
2013-10-31 16:09:35,561 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000002_0 which needs 1 slots
2013-10-31 16:09:35,561 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000003_0 which needs 1 slots
2013-10-31 16:09:35,561 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0011_m_000003_0 which needs 1 slots
2013-10-31 16:09:35,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken	dst=null	perm=null
2013-10-31 16:09:35,565 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34535, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8021674872422085597_1123, duration: 129745
2013-10-31 16:09:35,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml	dst=null	perm=null
2013-10-31 16:09:35,569 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34537, bytes: 28781, op: HDFS_READ, cliID: DFSClient_-19108433, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2920999921881403397_1120, duration: 160183
2013-10-31 16:09:35,582 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:35,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar	dst=null	perm=null
2013-10-31 16:09:35,594 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:35,594 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000001_0 0.0% 
2013-10-31 16:09:35,596 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34538, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-19108433, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1251994781094396070_1117, duration: 663355
2013-10-31 16:09:35,596 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000004_0' to tip task_20131031160444934_0011_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:09:35,596 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000004
2013-10-31 16:09:35,597 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:09:35,597 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000004_0 which needs 1 slots
2013-10-31 16:09:35,597 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000004_0 which needs 1 slots
2013-10-31 16:09:35,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken	dst=null	perm=null
2013-10-31 16:09:35,601 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34470, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8021674872422085597_1123, duration: 152214
2013-10-31 16:09:35,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml	dst=null	perm=null
2013-10-31 16:09:35,605 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34473, bytes: 28781, op: HDFS_READ, cliID: DFSClient_-872694833, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2920999921881403397_1120, duration: 157613
2013-10-31 16:09:35,617 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:35,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar	dst=null	perm=null
2013-10-31 16:09:35,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34543, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-872694833, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1251994781094396070_1117, duration: 733547
2013-10-31 16:09:35,650 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_-1008552155
2013-10-31 16:09:35,651 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_-1008552155 spawned.
2013-10-31 16:09:35,651 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_-1264582295
2013-10-31 16:09:35,652 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_-1264582295 spawned.
2013-10-31 16:09:35,652 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000003_0/taskjvm.sh
2013-10-31 16:09:35,653 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000002_0/taskjvm.sh
2013-10-31 16:09:35,773 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1477786192 given task: attempt_20131031160444934_0011_m_000000_0
2013-10-31 16:09:35,943 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_448877274
2013-10-31 16:09:35,944 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_448877274 spawned.
2013-10-31 16:09:35,945 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000004_0/taskjvm.sh
2013-10-31 16:09:36,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split	dst=null	perm=null
2013-10-31 16:09:36,278 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34545, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2068202829203503883_1118, duration: 168828
2013-10-31 16:09:36,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:09:36,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:36,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:36,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:36,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:36,606 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34477, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 140119
2013-10-31 16:09:36,609 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34478, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 135493
2013-10-31 16:09:36,617 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000. blk_4463643465988243742_1125
2013-10-31 16:09:36,640 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4463643465988243742_1125 src: /127.0.0.1:34548 dest: /127.0.0.1:38271
2013-10-31 16:09:36,641 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4463643465988243742_1125 src: /127.0.0.1:54585 dest: /127.0.0.1:41648
2013-10-31 16:09:36,641 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4463643465988243742_1125 src: /127.0.0.1:47583 dest: /127.0.0.1:47311
2013-10-31 16:09:36,644 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47583, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4463643465988243742_1125, duration: 1234664
2013-10-31 16:09:36,644 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4463643465988243742_1125 terminating
2013-10-31 16:09:36,644 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54585, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4463643465988243742_1125, duration: 1587430
2013-10-31 16:09:36,644 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4463643465988243742_1125 size 104
2013-10-31 16:09:36,644 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4463643465988243742_1125 terminating
2013-10-31 16:09:36,644 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34548, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4463643465988243742_1125, duration: 2025687
2013-10-31 16:09:36,644 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4463643465988243742_1125 size 104
2013-10-31 16:09:36,645 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4463643465988243742_1125 terminating
2013-10-31 16:09:36,646 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0011_m_000000_0
2013-10-31 16:09:36,646 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0011_m_000000_0
2013-10-31 16:09:36,647 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4463643465988243742_1125 size 104
2013-10-31 16:09:36,695 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:36,695 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000000_0 0.0% 
2013-10-31 16:09:37,026 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1008552155 given task: attempt_20131031160444934_0011_m_000003_0
2013-10-31 16:09:37,103 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_448877274 given task: attempt_20131031160444934_0011_m_000004_0
2013-10-31 16:09:37,106 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1264582295 given task: attempt_20131031160444934_0011_m_000002_0
2013-10-31 16:09:37,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split	dst=null	perm=null
2013-10-31 16:09:37,525 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34488, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2068202829203503883_1118, duration: 170299
2013-10-31 16:09:37,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:09:37,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34558, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 126748
2013-10-31 16:09:37,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:37,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split	dst=null	perm=null
2013-10-31 16:09:37,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split	dst=null	perm=null
2013-10-31 16:09:37,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:37,597 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34490, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2068202829203503883_1118, duration: 234669
2013-10-31 16:09:37,599 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34491, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2068202829203503883_1118, duration: 151967
2013-10-31 16:09:37,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:09:37,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:09:37,636 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34561, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 124856
2013-10-31 16:09:37,638 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47595, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 116494
2013-10-31 16:09:37,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:37,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:37,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:37,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:37,710 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000000_0
2013-10-31 16:09:37,710 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000001_0
2013-10-31 16:09:37,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:37,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:37,819 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54599, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 163496
2013-10-31 16:09:37,829 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003. blk_-7874678964818902618_1128
2013-10-31 16:09:37,851 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7874678964818902618_1128 src: /127.0.0.1:34564 dest: /127.0.0.1:38271
2013-10-31 16:09:37,852 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7874678964818902618_1128 src: /127.0.0.1:47598 dest: /127.0.0.1:47311
2013-10-31 16:09:37,853 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7874678964818902618_1128 src: /127.0.0.1:34497 dest: /127.0.0.1:50942
2013-10-31 16:09:37,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34497, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7874678964818902618_1128, duration: 1141287
2013-10-31 16:09:37,855 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7874678964818902618_1128 terminating
2013-10-31 16:09:37,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47598, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7874678964818902618_1128, duration: 1608669
2013-10-31 16:09:37,855 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7874678964818902618_1128 terminating
2013-10-31 16:09:37,856 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34564, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7874678964818902618_1128, duration: 2007387
2013-10-31 16:09:37,856 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7874678964818902618_1128 terminating
2013-10-31 16:09:37,858 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7874678964818902618_1128 size 104
2013-10-31 16:09:37,858 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7874678964818902618_1128 size 104
2013-10-31 16:09:37,860 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7874678964818902618_1128 size 104
2013-10-31 16:09:37,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:37,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:37,886 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54603, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 120995
2013-10-31 16:09:37,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:37,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:09:37,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54604, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 109715
2013-10-31 16:09:37,896 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004. blk_-3681265296073978596_1128
2013-10-31 16:09:37,903 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002. blk_6334597591235643953_1128
2013-10-31 16:09:37,919 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3681265296073978596_1128 src: /127.0.0.1:34569 dest: /127.0.0.1:38271
2013-10-31 16:09:37,920 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3681265296073978596_1128 src: /127.0.0.1:34502 dest: /127.0.0.1:50942
2013-10-31 16:09:37,921 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3681265296073978596_1128 src: /127.0.0.1:47605 dest: /127.0.0.1:47311
2013-10-31 16:09:37,923 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47605, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3681265296073978596_1128, duration: 1047807
2013-10-31 16:09:37,923 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3681265296073978596_1128 terminating
2013-10-31 16:09:37,923 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3681265296073978596_1128 size 104
2013-10-31 16:09:37,923 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34502, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3681265296073978596_1128, duration: 1400650
2013-10-31 16:09:37,923 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3681265296073978596_1128 terminating
2013-10-31 16:09:37,923 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34569, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3681265296073978596_1128, duration: 1751457
2013-10-31 16:09:37,924 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3681265296073978596_1128 terminating
2013-10-31 16:09:37,924 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0011_m_000004_0
2013-10-31 16:09:37,925 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0011_m_000004_0
2013-10-31 16:09:37,925 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3681265296073978596_1128 size 104
2013-10-31 16:09:37,925 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6334597591235643953_1128 src: /127.0.0.1:54606 dest: /127.0.0.1:41648
2013-10-31 16:09:37,925 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3681265296073978596_1128 size 104
2013-10-31 16:09:37,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6334597591235643953_1128 src: /127.0.0.1:34573 dest: /127.0.0.1:38271
2013-10-31 16:09:37,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6334597591235643953_1128 src: /127.0.0.1:34505 dest: /127.0.0.1:50942
2013-10-31 16:09:37,928 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34505, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6334597591235643953_1128, duration: 1094857
2013-10-31 16:09:37,928 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6334597591235643953_1128 terminating
2013-10-31 16:09:37,929 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34573, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6334597591235643953_1128, duration: 1344616
2013-10-31 16:09:37,929 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6334597591235643953_1128 size 104
2013-10-31 16:09:37,929 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6334597591235643953_1128 terminating
2013-10-31 16:09:37,929 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54606, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6334597591235643953_1128, duration: 1752182
2013-10-31 16:09:37,929 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6334597591235643953_1128 terminating
2013-10-31 16:09:37,930 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6334597591235643953_1128 size 104
2013-10-31 16:09:37,930 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0011_m_000002_0
2013-10-31 16:09:37,930 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0011_m_000002_0
2013-10-31 16:09:37,931 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6334597591235643953_1128 size 104
2013-10-31 16:09:37,975 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:37,975 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000004_0 0.0% 
2013-10-31 16:09:37,984 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:37,984 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000002_0 0.0% 
2013-10-31 16:09:38,258 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0011_m_000003_0
2013-10-31 16:09:38,258 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0011_m_000003_0
2013-10-31 16:09:38,323 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:38,324 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000003_0 0.0% 
2013-10-31 16:09:38,565 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000002_0
2013-10-31 16:09:38,566 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000003_0
2013-10-31 16:09:38,600 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000004_0
2013-10-31 16:09:38,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0	dst=null	perm=null
2013-10-31 16:09:38,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:38,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0	dst=null	perm=null
2013-10-31 16:09:38,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:38,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0	dst=null	perm=null
2013-10-31 16:09:38,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:38,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0	dst=null	perm=null
2013-10-31 16:09:38,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:39,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004	dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0	dst=null	perm=null
2013-10-31 16:09:39,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0	dst=null	perm=null
2013-10-31 16:09:39,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0	dst=null	perm=null
2013-10-31 16:09:39,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0	dst=null	perm=null
2013-10-31 16:09:39,207 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:09:39,209 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000000_0 is done.
2013-10-31 16:09:39,209 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000000_0  was -1
2013-10-31 16:09:39,209 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:09:39,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0	dst=null	perm=null
2013-10-31 16:09:39,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:39,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0	dst=null	perm=null
2013-10-31 16:09:39,709 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0011_m_000006_0
2013-10-31 16:09:39,710 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0011_m_000006_0
2013-10-31 16:09:39,710 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000006_0 not found in cache
2013-10-31 16:09:39,848 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:09:39,857 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,868 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,873 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,878 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,884 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,884 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:09:40,452 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:09:40,454 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000003_0 is done.
2013-10-31 16:09:40,455 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000003_0  was -1
2013-10-31 16:09:40,455 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:09:40,521 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:09:40,522 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000004_0 is done.
2013-10-31 16:09:40,522 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000004_0  was -1
2013-10-31 16:09:40,522 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:40,524 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:09:40,525 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000002_0 is done.
2013-10-31 16:09:40,525 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000002_0  was -1
2013-10-31 16:09:40,525 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:40,712 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000000_0' has completed task_20131031160444934_0011_m_000000 successfully.
2013-10-31 16:09:41,232 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:09:41,237 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:09:41,239 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000001_0 is done.
2013-10-31 16:09:41,239 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000001_0  was -1
2013-10-31 16:09:41,239 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:41,569 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000002_0' has completed task_20131031160444934_0011_m_000002 successfully.
2013-10-31 16:09:41,571 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000003_0' has completed task_20131031160444934_0011_m_000003 successfully.
2013-10-31 16:09:41,603 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000004_0' has completed task_20131031160444934_0011_m_000004 successfully.
2013-10-31 16:09:43,716 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000001_0' has completed task_20131031160444934_0011_m_000001 successfully.
2013-10-31 16:09:43,721 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0011_m_000005_0' to tip task_20131031160444934_0011_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:43,723 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:09:43,724 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000005_0 which needs 1 slots
2013-10-31 16:09:43,724 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000005_0 which needs 1 slots
2013-10-31 16:09:43,760 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0011/attempt_20131031160444934_0011_m_000005_0. Attempting to reuse: jvm_20131031160444934_0011_m_-1477786192
2013-10-31 16:09:44,267 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1477786192 given task: attempt_20131031160444934_0011_m_000005_0
2013-10-31 16:09:44,475 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000005_0 0.0% 
2013-10-31 16:09:44,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary	dst=null	perm=null
2013-10-31 16:09:44,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:44,498 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_SUCCESS from client DFSClient_attempt_20131031160444934_0011_m_000005_0
2013-10-31 16:09:44,498 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0011_m_000005_0
2013-10-31 16:09:44,509 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1251994781094396070 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:44,509 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1251994781094396070 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:44,509 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1251994781094396070 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:44,509 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1251994781094396070 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:44,510 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2068202829203503883 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:44,510 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2068202829203503883 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:44,510 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2068202829203503883 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:44,510 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2068202829203503883 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:44,511 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5329221742438129426 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:44,511 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5329221742438129426 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:44,511 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5329221742438129426 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:44,511 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2920999921881403397 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:44,511 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2920999921881403397 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:44,512 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2920999921881403397 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:44,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011	dst=null	perm=null
2013-10-31 16:09:45,210 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-5329221742438129426_1119 blk_-2068202829203503883_1118 blk_1251994781094396070_1117 blk_-2920999921881403397_1120
2013-10-31 16:09:45,210 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-5329221742438129426_1119 blk_-2068202829203503883_1118 blk_1251994781094396070_1117
2013-10-31 16:09:45,323 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5329221742438129426_1119 file build/test/data/dfs/data/data3/current/blk_-5329221742438129426 for deletion
2013-10-31 16:09:45,323 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2068202829203503883_1118 file build/test/data/dfs/data/data4/current/blk_-2068202829203503883 for deletion
2013-10-31 16:09:45,323 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5329221742438129426_1119 at file build/test/data/dfs/data/data3/current/blk_-5329221742438129426
2013-10-31 16:09:45,323 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1251994781094396070_1117 file build/test/data/dfs/data/data3/current/blk_1251994781094396070 for deletion
2013-10-31 16:09:45,324 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2068202829203503883_1118 at file build/test/data/dfs/data/data4/current/blk_-2068202829203503883
2013-10-31 16:09:45,324 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1251994781094396070_1117 at file build/test/data/dfs/data/data3/current/blk_1251994781094396070
2013-10-31 16:09:45,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5329221742438129426_1119 file build/test/data/dfs/data/data6/current/blk_-5329221742438129426 for deletion
2013-10-31 16:09:45,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2920999921881403397_1120 file build/test/data/dfs/data/data5/current/blk_-2920999921881403397 for deletion
2013-10-31 16:09:45,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5329221742438129426_1119 at file build/test/data/dfs/data/data6/current/blk_-5329221742438129426
2013-10-31 16:09:45,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2068202829203503883_1118 file build/test/data/dfs/data/data5/current/blk_-2068202829203503883 for deletion
2013-10-31 16:09:45,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2920999921881403397_1120 at file build/test/data/dfs/data/data5/current/blk_-2920999921881403397
2013-10-31 16:09:45,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1251994781094396070_1117 file build/test/data/dfs/data/data6/current/blk_1251994781094396070 for deletion
2013-10-31 16:09:45,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2068202829203503883_1118 at file build/test/data/dfs/data/data5/current/blk_-2068202829203503883
2013-10-31 16:09:45,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1251994781094396070_1117 at file build/test/data/dfs/data/data6/current/blk_1251994781094396070
2013-10-31 16:09:47,437 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000005_0 0.0% cleanup
2013-10-31 16:09:47,439 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000005_0 is done.
2013-10-31 16:09:47,439 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000005_0  was -1
2013-10-31 16:09:47,439 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:48,211 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-2068202829203503883_1118 blk_1251994781094396070_1117 blk_-2920999921881403397_1120
2013-10-31 16:09:48,211 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5329221742438129426_1119 blk_-2068202829203503883_1118 blk_1251994781094396070_1117 blk_-2920999921881403397_1120
2013-10-31 16:09:49,730 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000005_0' has completed task_20131031160444934_0011_m_000005 successfully.
2013-10-31 16:09:49,731 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0011 has completed successfully.
2013-10-31 16:09:49,731 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0011,submitTime=1383235764892,launchTime=1383235767467,firstMapTaskLaunchTime=1383235774703,firstJobSetupTaskLaunchTime=1383235768558,firstJobCleanupTaskLaunchTime=1383235783721,finishTime=1383235789731,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[C96242DE50E048DEA55073ACCDC74EF6/B5A2F1F6415F49408144B67DCA7F4220] cogrouping/(2/2)
2013-10-31 16:09:49,820 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940. blk_4928171777644314206_1129
2013-10-31 16:09:49,823 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4928171777644314206_1129 src: /127.0.0.1:54613 dest: /127.0.0.1:41648
2013-10-31 16:09:49,825 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4928171777644314206_1129 src: /127.0.0.1:34509 dest: /127.0.0.1:50942
2013-10-31 16:09:49,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4928171777644314206_1129 src: /127.0.0.1:47612 dest: /127.0.0.1:47311
2013-10-31 16:09:49,835 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47612, dest: /127.0.0.1:47311, bytes: 26344, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4928171777644314206_1129, duration: 4915184
2013-10-31 16:09:49,836 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4928171777644314206_1129 terminating
2013-10-31 16:09:49,836 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34509, dest: /127.0.0.1:50942, bytes: 26344, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4928171777644314206_1129, duration: 4904892
2013-10-31 16:09:49,837 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4928171777644314206_1129 terminating
2013-10-31 16:09:49,837 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54613, dest: /127.0.0.1:41648, bytes: 26344, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4928171777644314206_1129, duration: 5772035
2013-10-31 16:09:49,838 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4928171777644314206_1129 terminating
2013-10-31 16:09:49,842 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4928171777644314206_1129 size 26344
2013-10-31 16:09:49,843 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940 from client DFSClient_400949537
2013-10-31 16:09:49,843 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940 is closed by DFSClient_400949537
2013-10-31 16:09:49,844 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 693 Total time for transactions(ms): 11Number of transactions batched in Syncs: 64 Number of syncs: 492 SyncTimes(ms): 20461 2621 
2013-10-31 16:09:49,844 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4928171777644314206_1129 size 26344
2013-10-31 16:09:49,844 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4928171777644314206_1129 size 26344
2013-10-31 16:09:49,853 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:09:49,856 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000000_0'
2013-10-31 16:09:49,856 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000001_0'
2013-10-31 16:09:49,856 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000005_0'
2013-10-31 16:09:49,856 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000006_0'
2013-10-31 16:09:49,862 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0011_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:09:49,863 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (1/2) ...tform/joinsintocogrouprhs
2013-10-31 16:09:49,872 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:09:49,873 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8021674872422085597 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:49,873 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8021674872422085597 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:49,873 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8021674872422085597 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:49,875 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:09:49,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011	dst=null	perm=null
2013-10-31 16:09:49,880 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:09:49,880 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:09:49,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:49,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:09:49,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:49,948 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar. blk_145049323396269548_1130
2013-10-31 16:09:49,949 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_145049323396269548_1130 src: /127.0.0.1:34512 dest: /127.0.0.1:50942
2013-10-31 16:09:49,951 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_145049323396269548_1130 src: /127.0.0.1:34582 dest: /127.0.0.1:38271
2013-10-31 16:09:49,953 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_145049323396269548_1130 src: /127.0.0.1:47616 dest: /127.0.0.1:47311
2013-10-31 16:09:49,966 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47616, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_145049323396269548_1130, duration: 9453948
2013-10-31 16:09:49,966 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_145049323396269548_1130 terminating
2013-10-31 16:09:49,966 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34582, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_145049323396269548_1130, duration: 11050344
2013-10-31 16:09:49,967 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_145049323396269548_1130 size 238055
2013-10-31 16:09:49,967 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_145049323396269548_1130 terminating
2013-10-31 16:09:49,967 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34512, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_145049323396269548_1130, duration: 11200886
2013-10-31 16:09:49,968 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_145049323396269548_1130 size 238055
2013-10-31 16:09:49,968 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_145049323396269548_1130 terminating
2013-10-31 16:09:49,970 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar from client DFSClient_1457307213
2013-10-31 16:09:49,970 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar is closed by DFSClient_1457307213
2013-10-31 16:09:49,971 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_145049323396269548_1130 size 238055
2013-10-31 16:09:49,979 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar. New replication is 10
2013-10-31 16:09:49,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar	dst=null	perm=null
2013-10-31 16:09:49,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:49,994 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:09:49,999 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:50,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:09:50,003 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:50,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:09:50,006 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:50,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:09:50,009 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:50,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:09:50,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,421 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split. New replication is 10
2013-10-31 16:09:50,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split	dst=null	perm=null
2013-10-31 16:09:50,429 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split. blk_-179423042782344656_1131
2013-10-31 16:09:50,431 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-179423042782344656_1131 src: /127.0.0.1:54620 dest: /127.0.0.1:41648
2013-10-31 16:09:50,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-179423042782344656_1131 src: /127.0.0.1:34585 dest: /127.0.0.1:38271
2013-10-31 16:09:50,434 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-179423042782344656_1131 src: /127.0.0.1:34517 dest: /127.0.0.1:50942
2013-10-31 16:09:50,436 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-179423042782344656_1131 src: /127.0.0.1:47620 dest: /127.0.0.1:47311
2013-10-31 16:09:50,439 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47620, dest: /127.0.0.1:47311, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-179423042782344656_1131, duration: 93519
2013-10-31 16:09:50,440 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-179423042782344656_1131 terminating
2013-10-31 16:09:50,440 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34517, dest: /127.0.0.1:50942, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-179423042782344656_1131, duration: 946768
2013-10-31 16:09:50,441 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-179423042782344656_1131 terminating
2013-10-31 16:09:50,441 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34585, dest: /127.0.0.1:38271, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-179423042782344656_1131, duration: 1948361
2013-10-31 16:09:50,441 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-179423042782344656_1131 terminating
2013-10-31 16:09:50,442 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-179423042782344656_1131 size 1722
2013-10-31 16:09:50,442 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54620, dest: /127.0.0.1:41648, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-179423042782344656_1131, duration: 2685288
2013-10-31 16:09:50,443 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-179423042782344656_1131 terminating
2013-10-31 16:09:50,445 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-179423042782344656_1131 size 1722
2013-10-31 16:09:50,445 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split from client DFSClient_1457307213
2013-10-31 16:09:50,446 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split is closed by DFSClient_1457307213
2013-10-31 16:09:50,446 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-179423042782344656_1131 size 1722
2013-10-31 16:09:50,447 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-179423042782344656_1131 size 1722
2013-10-31 16:09:50,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,468 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo. blk_-8375126459452884425_1132
2013-10-31 16:09:50,470 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8375126459452884425_1132 src: /127.0.0.1:34588 dest: /127.0.0.1:38271
2013-10-31 16:09:50,471 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8375126459452884425_1132 src: /127.0.0.1:47622 dest: /127.0.0.1:47311
2013-10-31 16:09:50,473 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8375126459452884425_1132 src: /127.0.0.1:54626 dest: /127.0.0.1:41648
2013-10-31 16:09:50,476 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54626, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8375126459452884425_1132, duration: 75715
2013-10-31 16:09:50,477 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8375126459452884425_1132 terminating
2013-10-31 16:09:50,477 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47622, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8375126459452884425_1132, duration: 893534
2013-10-31 16:09:50,478 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8375126459452884425_1132 terminating
2013-10-31 16:09:50,478 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34588, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8375126459452884425_1132, duration: 1926812
2013-10-31 16:09:50,479 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8375126459452884425_1132 size 183
2013-10-31 16:09:50,479 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8375126459452884425_1132 terminating
2013-10-31 16:09:50,480 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:09:50,481 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:09:50,481 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8375126459452884425_1132 size 183
2013-10-31 16:09:50,482 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8375126459452884425_1132 size 183
2013-10-31 16:09:50,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,509 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml. blk_-8922866185159813262_1133
2013-10-31 16:09:50,511 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8922866185159813262_1133 src: /127.0.0.1:34591 dest: /127.0.0.1:38271
2013-10-31 16:09:50,512 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8922866185159813262_1133 src: /127.0.0.1:54628 dest: /127.0.0.1:41648
2013-10-31 16:09:50,514 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8922866185159813262_1133 src: /127.0.0.1:47626 dest: /127.0.0.1:47311
2013-10-31 16:09:50,517 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47626, dest: /127.0.0.1:47311, bytes: 29848, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8922866185159813262_1133, duration: 104421
2013-10-31 16:09:50,517 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8922866185159813262_1133 terminating
2013-10-31 16:09:50,518 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54628, dest: /127.0.0.1:41648, bytes: 29848, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8922866185159813262_1133, duration: 941104
2013-10-31 16:09:50,519 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8922866185159813262_1133 size 29848
2013-10-31 16:09:50,519 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8922866185159813262_1133 terminating
2013-10-31 16:09:50,519 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8922866185159813262_1133 size 29848
2013-10-31 16:09:50,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34591, dest: /127.0.0.1:38271, bytes: 29848, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8922866185159813262_1133, duration: 2140751
2013-10-31 16:09:50,520 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8922866185159813262_1133 terminating
2013-10-31 16:09:50,521 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml from client DFSClient_1457307213
2013-10-31 16:09:50,522 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml is closed by DFSClient_1457307213
2013-10-31 16:09:50,523 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8922866185159813262_1133 size 29848
2013-10-31 16:09:50,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml	dst=null	perm=null
2013-10-31 16:09:50,540 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34595, bytes: 30084, op: HDFS_READ, cliID: DFSClient_319165589, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8922866185159813262_1133, duration: 404377
2013-10-31 16:09:50,556 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0012: nMaps=5 nReduces=1 max=-1
2013-10-31 16:09:50,556 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0012 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:09:50,556 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0012	RESULT=SUCCESS
2013-10-31 16:09:50,556 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0012
2013-10-31 16:09:50,556 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0012
2013-10-31 16:09:50,556 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0012
2013-10-31 16:09:50,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,582 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000002_0'
2013-10-31 16:09:50,583 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000003_0'
2013-10-31 16:09:50,587 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_conf.xml. blk_147876096733075238_1135
2013-10-31 16:09:50,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_147876096733075238_1135 src: /127.0.0.1:47629 dest: /127.0.0.1:47311
2013-10-31 16:09:50,590 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_147876096733075238_1135 src: /127.0.0.1:54633 dest: /127.0.0.1:41648
2013-10-31 16:09:50,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_147876096733075238_1135 src: /127.0.0.1:34529 dest: /127.0.0.1:50942
2013-10-31 16:09:50,595 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34529, dest: /127.0.0.1:50942, bytes: 29913, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_147876096733075238_1135, duration: 691875
2013-10-31 16:09:50,596 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_147876096733075238_1135 terminating
2013-10-31 16:09:50,596 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_147876096733075238_1135 size 29913
2013-10-31 16:09:50,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54633, dest: /127.0.0.1:41648, bytes: 29913, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_147876096733075238_1135, duration: 1890132
2013-10-31 16:09:50,597 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_147876096733075238_1135 size 29913
2013-10-31 16:09:50,597 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_147876096733075238_1135 terminating
2013-10-31 16:09:50,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47629, dest: /127.0.0.1:47311, bytes: 29913, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_147876096733075238_1135, duration: 2447021
2013-10-31 16:09:50,598 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_147876096733075238_1135 size 29913
2013-10-31 16:09:50,598 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_147876096733075238_1135 terminating
2013-10-31 16:09:50,599 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_conf.xml from client DFSClient_319165589
2013-10-31 16:09:50,600 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_conf.xml is closed by DFSClient_319165589
2013-10-31 16:09:50,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,613 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken. blk_2658578484986837675_1136
2013-10-31 16:09:50,614 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000004_0'
2013-10-31 16:09:50,615 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2658578484986837675_1136 src: /127.0.0.1:34530 dest: /127.0.0.1:50942
2013-10-31 16:09:50,617 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2658578484986837675_1136 src: /127.0.0.1:34600 dest: /127.0.0.1:38271
2013-10-31 16:09:50,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2658578484986837675_1136 src: /127.0.0.1:54637 dest: /127.0.0.1:41648
2013-10-31 16:09:50,621 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54637, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2658578484986837675_1136, duration: 458717
2013-10-31 16:09:50,622 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2658578484986837675_1136 terminating
2013-10-31 16:09:50,622 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2658578484986837675_1136 size 116
2013-10-31 16:09:50,622 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34600, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2658578484986837675_1136, duration: 1224754
2013-10-31 16:09:50,623 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2658578484986837675_1136 size 116
2013-10-31 16:09:50,623 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2658578484986837675_1136 terminating
2013-10-31 16:09:50,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34530, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2658578484986837675_1136, duration: 2387328
2013-10-31 16:09:50,625 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2658578484986837675_1136 terminating
2013-10-31 16:09:50,627 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken from client DFSClient_1457307213
2013-10-31 16:09:50,628 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken is closed by DFSClient_1457307213
2013-10-31 16:09:50,628 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2658578484986837675_1136 size 116
2013-10-31 16:09:50,633 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken
2013-10-31 16:09:50,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:09:50,637 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47635, bytes: 187, op: HDFS_READ, cliID: DFSClient_319165589, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8375126459452884425_1132, duration: 264141
2013-10-31 16:09:50,639 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0012 = 103. Number of splits = 5
2013-10-31 16:09:50,639 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,639 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,639 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,641 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,641 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,641 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,641 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,642 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,642 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,642 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,642 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0012 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:09:50,643 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0012 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:09:50,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5329221742438129426_1119 file build/test/data/dfs/data/data2/current/blk_-5329221742438129426 for deletion
2013-10-31 16:09:50,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2920999921881403397_1120 file build/test/data/dfs/data/data1/current/blk_-2920999921881403397 for deletion
2013-10-31 16:09:50,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5329221742438129426_1119 at file build/test/data/dfs/data/data2/current/blk_-5329221742438129426
2013-10-31 16:09:50,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2068202829203503883_1118 file build/test/data/dfs/data/data1/current/blk_-2068202829203503883 for deletion
2013-10-31 16:09:50,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2920999921881403397_1120 at file build/test/data/dfs/data/data1/current/blk_-2920999921881403397
2013-10-31 16:09:50,726 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1251994781094396070_1117 file build/test/data/dfs/data/data2/current/blk_1251994781094396070 for deletion
2013-10-31 16:09:50,726 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2068202829203503883_1118 at file build/test/data/dfs/data/data1/current/blk_-2068202829203503883
2013-10-31 16:09:50,726 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1251994781094396070_1117 at file build/test/data/dfs/data/data2/current/blk_1251994781094396070
2013-10-31 16:09:50,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2920999921881403397_1120 file build/test/data/dfs/data/data8/current/blk_-2920999921881403397 for deletion
2013-10-31 16:09:50,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2068202829203503883_1118 file build/test/data/dfs/data/data7/current/blk_-2068202829203503883 for deletion
2013-10-31 16:09:50,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2920999921881403397_1120 at file build/test/data/dfs/data/data8/current/blk_-2920999921881403397
2013-10-31 16:09:50,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2068202829203503883_1118 at file build/test/data/dfs/data/data7/current/blk_-2068202829203503883
2013-10-31 16:09:50,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1251994781094396070_1117 file build/test/data/dfs/data/data7/current/blk_1251994781094396070 for deletion
2013-10-31 16:09:50,928 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1251994781094396070_1117 at file build/test/data/dfs/data/data7/current/blk_1251994781094396070
2013-10-31 16:09:51,212 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_145049323396269548_1130 to datanode(s) 127.0.0.1:41648
2013-10-31 16:09:51,212 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_8021674872422085597_1123
2013-10-31 16:09:51,212 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_8021674872422085597_1123
2013-10-31 16:09:51,324 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8021674872422085597_1123 file build/test/data/dfs/data/data4/current/blk_8021674872422085597 for deletion
2013-10-31 16:09:51,325 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8021674872422085597_1123 at file build/test/data/dfs/data/data4/current/blk_8021674872422085597
2013-10-31 16:09:52,588 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0012_m_000006_0' to tip task_20131031160444934_0012_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:09:52,593 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:09:52,594 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000006_0 which needs 1 slots
2013-10-31 16:09:52,594 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0011
2013-10-31 16:09:52,594 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000006_0 which needs 1 slots
2013-10-31 16:09:52,594 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0011 being deleted.
2013-10-31 16:09:52,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken	dst=null	perm=null
2013-10-31 16:09:52,603 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54639, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2658578484986837675_1136, duration: 301515
2013-10-31 16:09:52,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml	dst=null	perm=null
2013-10-31 16:09:52,613 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34605, bytes: 30084, op: HDFS_READ, cliID: DFSClient_-1972287322, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8922866185159813262_1133, duration: 378227
2013-10-31 16:09:52,644 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:52,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar	dst=null	perm=null
2013-10-31 16:09:52,678 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47639, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1972287322, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_145049323396269548_1130, duration: 1621354
2013-10-31 16:09:52,776 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_-2020008089
2013-10-31 16:09:52,777 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_-2020008089 spawned.
2013-10-31 16:09:52,779 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000006_0/taskjvm.sh
2013-10-31 16:09:53,726 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_145049323396269548_1130 to 127.0.0.1:41648 
2013-10-31 16:09:53,728 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_145049323396269548_1130 src: /127.0.0.1:54643 dest: /127.0.0.1:41648
2013-10-31 16:09:53,728 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_145049323396269548_1130 to /127.0.0.1:41648
2013-10-31 16:09:53,731 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_145049323396269548_1130 src: /127.0.0.1:54643 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:09:53,735 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_145049323396269548_1130 size 238055
2013-10-31 16:09:53,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8021674872422085597_1123 file build/test/data/dfs/data/data8/current/blk_8021674872422085597 for deletion
2013-10-31 16:09:53,928 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8021674872422085597_1123 at file build/test/data/dfs/data/data8/current/blk_8021674872422085597
2013-10-31 16:09:54,213 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_8021674872422085597_1123
2013-10-31 16:09:54,496 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-2020008089 given task: attempt_20131031160444934_0012_m_000006_0
2013-10-31 16:09:54,859 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0011
2013-10-31 16:09:54,860 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000001_0 not found in cache
2013-10-31 16:09:54,860 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000000_0 not found in cache
2013-10-31 16:09:54,860 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000005_0 not found in cache
2013-10-31 16:09:54,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0011 for user-log deletion with retainTimeStamp:1383322194861
2013-10-31 16:09:55,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:55,283 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_-1944950700 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:55,293 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16118 with signal TERM. Exit code 0
2013-10-31 16:09:55,476 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_-1477786192 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:55,480 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:55,480 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:55,480 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:55,484 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16243 with signal TERM. Exit code 0
2013-10-31 16:09:55,484 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_-1944950700 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:09:55,583 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0011
2013-10-31 16:09:55,584 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000003_0 not found in cache
2013-10-31 16:09:55,584 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000002_0 not found in cache
2013-10-31 16:09:55,585 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0011 for user-log deletion with retainTimeStamp:1383322195584
2013-10-31 16:09:55,615 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0011
2013-10-31 16:09:55,615 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000004_0 not found in cache
2013-10-31 16:09:55,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0011 for user-log deletion with retainTimeStamp:1383322195616
2013-10-31 16:09:55,652 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:55,652 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:55,652 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:55,653 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_-1477786192 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:09:56,027 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_-1008552155 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:56,036 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16350 with signal TERM. Exit code 0
2013-10-31 16:09:56,077 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_448877274 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:56,077 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_-1264582295 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:56,091 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16386 with signal TERM. Exit code 0
2013-10-31 16:09:56,091 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16387 with signal TERM. Exit code 0
2013-10-31 16:09:56,254 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:56,254 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:56,254 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:56,254 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_-1008552155 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:56,279 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:56,279 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:56,279 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:56,279 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:56,279 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:56,279 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_448877274 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:56,280 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:09:56,280 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_-1264582295 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:56,727 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8021674872422085597_1123 file build/test/data/dfs/data/data1/current/blk_8021674872422085597 for deletion
2013-10-31 16:09:56,727 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8021674872422085597_1123 at file build/test/data/dfs/data/data1/current/blk_8021674872422085597
2013-10-31 16:09:57,945 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000006_0 0.0% setup
2013-10-31 16:09:57,948 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000006_0 is done.
2013-10-31 16:09:57,948 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000006_0  was -1
2013-10-31 16:09:57,949 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:58,600 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000006_0' has completed task_20131031160444934_0012_m_000006 successfully.
2013-10-31 16:09:58,603 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000000_0' to tip task_20131031160444934_0012_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:09:58,604 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000000
2013-10-31 16:09:58,604 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000001_0' to tip task_20131031160444934_0012_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:09:58,605 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000001
2013-10-31 16:09:58,607 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:09:58,608 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:09:58,608 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000000_0 which needs 1 slots
2013-10-31 16:09:58,608 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000000_0 which needs 1 slots
2013-10-31 16:09:58,609 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000001_0 which needs 1 slots
2013-10-31 16:09:58,609 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0012_m_000001_0 which needs 1 slots
2013-10-31 16:09:58,656 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_-1151686836
2013-10-31 16:09:58,657 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_-1151686836 spawned.
2013-10-31 16:09:58,658 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0012/attempt_20131031160444934_0012_m_000001_0. Attempting to reuse: jvm_20131031160444934_0012_m_-2020008089
2013-10-31 16:09:58,659 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000000_0/taskjvm.sh
2013-10-31 16:09:58,869 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000002_0' to tip task_20131031160444934_0012_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:58,870 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000002
2013-10-31 16:09:58,870 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000003_0' to tip task_20131031160444934_0012_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:58,871 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000003
2013-10-31 16:09:58,872 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:09:58,872 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:09:58,872 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000002_0 which needs 1 slots
2013-10-31 16:09:58,872 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000002_0 which needs 1 slots
2013-10-31 16:09:58,873 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000003_0 which needs 1 slots
2013-10-31 16:09:58,873 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0012_m_000003_0 which needs 1 slots
2013-10-31 16:09:58,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken	dst=null	perm=null
2013-10-31 16:09:58,881 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34542, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2658578484986837675_1136, duration: 289092
2013-10-31 16:09:58,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml	dst=null	perm=null
2013-10-31 16:09:58,892 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54649, bytes: 30084, op: HDFS_READ, cliID: DFSClient_1709281947, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8922866185159813262_1133, duration: 385380
2013-10-31 16:09:58,906 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:58,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar	dst=null	perm=null
2013-10-31 16:09:58,920 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34545, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1709281947, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_145049323396269548_1130, duration: 664883
2013-10-31 16:09:58,973 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_1792759549
2013-10-31 16:09:58,974 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_1792759549 spawned.
2013-10-31 16:09:58,974 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_-1393587902
2013-10-31 16:09:58,975 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_-1393587902 spawned.
2013-10-31 16:09:58,976 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000003_0/taskjvm.sh
2013-10-31 16:09:58,976 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000002_0/taskjvm.sh
2013-10-31 16:09:59,007 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-2020008089 given task: attempt_20131031160444934_0012_m_000001_0
2013-10-31 16:09:59,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split	dst=null	perm=null
2013-10-31 16:09:59,121 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34547, bytes: 1738, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-179423042782344656_1131, duration: 169255
2013-10-31 16:09:59,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:09:59,161 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34617, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 104879
2013-10-31 16:09:59,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787	dst=null	perm=null
2013-10-31 16:09:59,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000	dst=null	perm=null
2013-10-31 16:09:59,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001	dst=null	perm=null
2013-10-31 16:09:59,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002	dst=null	perm=null
2013-10-31 16:09:59,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003	dst=null	perm=null
2013-10-31 16:09:59,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004	dst=null	perm=null
2013-10-31 16:09:59,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000	dst=null	perm=null
2013-10-31 16:09:59,475 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34619, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4463643465988243742_1125, duration: 141736
2013-10-31 16:09:59,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001	dst=null	perm=null
2013-10-31 16:09:59,483 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34551, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2376389404784738128_1124, duration: 114004
2013-10-31 16:09:59,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002	dst=null	perm=null
2013-10-31 16:09:59,486 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54657, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6334597591235643953_1128, duration: 104595
2013-10-31 16:09:59,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003	dst=null	perm=null
2013-10-31 16:09:59,489 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34553, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7874678964818902618_1128, duration: 104699
2013-10-31 16:09:59,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004	dst=null	perm=null
2013-10-31 16:09:59,492 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34554, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3681265296073978596_1128, duration: 100949
2013-10-31 16:09:59,585 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-1151686836 given task: attempt_20131031160444934_0012_m_000000_0
2013-10-31 16:09:59,591 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000004_0' to tip task_20131031160444934_0012_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:09:59,592 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000004
2013-10-31 16:09:59,592 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:09:59,593 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000004_0 which needs 1 slots
2013-10-31 16:09:59,593 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000004_0 which needs 1 slots
2013-10-31 16:09:59,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken	dst=null	perm=null
2013-10-31 16:09:59,597 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34624, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2658578484986837675_1136, duration: 139720
2013-10-31 16:09:59,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml	dst=null	perm=null
2013-10-31 16:09:59,601 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34626, bytes: 30084, op: HDFS_READ, cliID: DFSClient_1501765769, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8922866185159813262_1133, duration: 166707
2013-10-31 16:09:59,614 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:59,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar	dst=null	perm=null
2013-10-31 16:09:59,628 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47660, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1501765769, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_145049323396269548_1130, duration: 661904
2013-10-31 16:09:59,682 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_-307168687
2013-10-31 16:09:59,682 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_-307168687 spawned.
2013-10-31 16:09:59,683 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000004_0/taskjvm.sh
2013-10-31 16:10:00,040 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_1792759549 given task: attempt_20131031160444934_0012_m_000003_0
2013-10-31 16:10:00,061 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-1393587902 given task: attempt_20131031160444934_0012_m_000002_0
2013-10-31 16:10:00,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split	dst=null	perm=null
2013-10-31 16:10:00,283 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34631, bytes: 1738, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-179423042782344656_1131, duration: 179847
2013-10-31 16:10:00,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:10:00,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split	dst=null	perm=null
2013-10-31 16:10:00,541 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54670, bytes: 706, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-179423042782344656_1131, duration: 170990
2013-10-31 16:10:00,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split	dst=null	perm=null
2013-10-31 16:10:00,555 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54671, bytes: 1222, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-179423042782344656_1131, duration: 221742
2013-10-31 16:10:00,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:10:00,581 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34637, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 116372
2013-10-31 16:10:00,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:10:00,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787	dst=null	perm=null
2013-10-31 16:10:00,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000	dst=null	perm=null
2013-10-31 16:10:00,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001	dst=null	perm=null
2013-10-31 16:10:00,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002	dst=null	perm=null
2013-10-31 16:10:00,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003	dst=null	perm=null
2013-10-31 16:10:00,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004	dst=null	perm=null
2013-10-31 16:10:00,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000	dst=null	perm=null
2013-10-31 16:10:00,623 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54674, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4463643465988243742_1125, duration: 262158
2013-10-31 16:10:00,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001	dst=null	perm=null
2013-10-31 16:10:00,633 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47672, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2376389404784738128_1124, duration: 150126
2013-10-31 16:10:00,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002	dst=null	perm=null
2013-10-31 16:10:00,636 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34640, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6334597591235643953_1128, duration: 111844
2013-10-31 16:10:00,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003	dst=null	perm=null
2013-10-31 16:10:00,639 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34641, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7874678964818902618_1128, duration: 113088
2013-10-31 16:10:00,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004	dst=null	perm=null
2013-10-31 16:10:00,642 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47675, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3681265296073978596_1128, duration: 132033
2013-10-31 16:10:00,645 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54679, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 99026
2013-10-31 16:10:00,752 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-307168687 given task: attempt_20131031160444934_0012_m_000004_0
2013-10-31 16:10:00,851 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54681, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 138714
2013-10-31 16:10:01,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split	dst=null	perm=null
2013-10-31 16:10:01,873 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34578, bytes: 706, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-179423042782344656_1131, duration: 375099
2013-10-31 16:10:01,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:10:01,913 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47681, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 257682
2013-10-31 16:10:02,085 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+26
2013-10-31 16:10:02,087 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000001_0 is done.
2013-10-31 16:10:02,087 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000001_0  was 264
2013-10-31 16:10:02,087 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:10:03,210 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+26
2013-10-31 16:10:03,213 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000000_0 is done.
2013-10-31 16:10:03,213 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000000_0  was 307
2013-10-31 16:10:03,214 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:03,469 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:17+17
2013-10-31 16:10:03,471 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000003_0 is done.
2013-10-31 16:10:03,471 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000003_0  was 82
2013-10-31 16:10:03,472 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:10:03,484 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:0+17
2013-10-31 16:10:03,486 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000002_0 is done.
2013-10-31 16:10:03,487 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000002_0  was 101
2013-10-31 16:10:03,487 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:03,608 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0012_m_000006_0
2013-10-31 16:10:03,609 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0012_m_000006_0
2013-10-31 16:10:03,609 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0012_m_000006_0 not found in cache
2013-10-31 16:10:04,614 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000000_0' has completed task_20131031160444934_0012_m_000000 successfully.
2013-10-31 16:10:04,616 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000001_0' has completed task_20131031160444934_0012_m_000001 successfully.
2013-10-31 16:10:04,618 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0012_r_000000_0' to tip task_20131031160444934_0012_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:04,620 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:10:04,620 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_r_000000_0 which needs 1 slots
2013-10-31 16:10:04,621 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_r_000000_0 which needs 1 slots
2013-10-31 16:10:04,658 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_r_1984937276
2013-10-31 16:10:04,659 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_r_1984937276 spawned.
2013-10-31 16:10:04,660 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_r_000000_0/taskjvm.sh
2013-10-31 16:10:04,782 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:34+17
2013-10-31 16:10:04,784 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000004_0 is done.
2013-10-31 16:10:04,785 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000004_0  was 82
2013-10-31 16:10:04,785 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:04,877 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000002_0' has completed task_20131031160444934_0012_m_000002 successfully.
2013-10-31 16:10:04,952 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000003_0' has completed task_20131031160444934_0012_m_000003 successfully.
2013-10-31 16:10:05,599 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000004_0' has completed task_20131031160444934_0012_m_000004 successfully.
2013-10-31 16:10:05,743 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_r_1984937276 given task: attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:11,402 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46375, bytes: 307, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000000_0, duration: 8883751
2013-10-31 16:10:11,427 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46375, bytes: 264, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000001_0, duration: 11545281
2013-10-31 16:10:11,445 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58308, bytes: 101, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000002_0, duration: 13342177
2013-10-31 16:10:11,462 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58309, bytes: 82, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000003_0, duration: 11892076
2013-10-31 16:10:11,479 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42512, bytes: 82, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000004_0, duration: 12354623
2013-10-31 16:10:12,223 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:10:12,266 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:10:12,327 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:10:12,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:12,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:12,593 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000. blk_6244668509629146044_1137
2013-10-31 16:10:12,616 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6244668509629146044_1137 src: /127.0.0.1:54691 dest: /127.0.0.1:41648
2013-10-31 16:10:12,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6244668509629146044_1137 src: /127.0.0.1:34587 dest: /127.0.0.1:50942
2013-10-31 16:10:12,620 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6244668509629146044_1137 src: /127.0.0.1:34657 dest: /127.0.0.1:38271
2013-10-31 16:10:12,626 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34657, dest: /127.0.0.1:38271, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0012_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6244668509629146044_1137, duration: 3386268
2013-10-31 16:10:12,627 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6244668509629146044_1137 terminating
2013-10-31 16:10:12,627 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34587, dest: /127.0.0.1:50942, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0012_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6244668509629146044_1137, duration: 1996397
2013-10-31 16:10:12,630 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6244668509629146044_1137 terminating
2013-10-31 16:10:12,631 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6244668509629146044_1137 size 592
2013-10-31 16:10:12,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54691, dest: /127.0.0.1:41648, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0012_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6244668509629146044_1137, duration: 5619946
2013-10-31 16:10:12,631 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6244668509629146044_1137 size 592
2013-10-31 16:10:12,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6244668509629146044_1137 terminating
2013-10-31 16:10:12,636 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6244668509629146044_1137 size 592
2013-10-31 16:10:12,636 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:12,637 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:12,696 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0012_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:12,696 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:10:13,629 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031160444934_0012_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:10:13,630 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:13,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0	dst=null	perm=null
2013-10-31 16:10:13,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:13,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:13,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0	dst=null	perm=null
2013-10-31 16:10:15,285 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 1.0% reduce > reduce
2013-10-31 16:10:15,286 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 1.0% reduce > reduce
2013-10-31 16:10:15,287 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_r_000000_0 is done.
2013-10-31 16:10:15,287 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_r_000000_0  was -1
2013-10-31 16:10:15,288 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:16,634 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_r_000000_0' has completed task_20131031160444934_0012_r_000000 successfully.
2013-10-31 16:10:16,639 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0012_m_000005_0' to tip task_20131031160444934_0012_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:16,643 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:10:16,643 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000005_0 which needs 1 slots
2013-10-31 16:10:16,643 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000005_0 which needs 1 slots
2013-10-31 16:10:16,679 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0012/attempt_20131031160444934_0012_m_000005_0. Attempting to reuse: jvm_20131031160444934_0012_m_-2020008089
2013-10-31 16:10:17,631 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-2020008089 given task: attempt_20131031160444934_0012_m_000005_0
2013-10-31 16:10:17,735 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000005_0 0.0% 
2013-10-31 16:10:17,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary	dst=null	perm=null
2013-10-31 16:10:17,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:17,758 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS from client DFSClient_attempt_20131031160444934_0012_m_000005_0
2013-10-31 16:10:17,758 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0012_m_000005_0
2013-10-31 16:10:17,765 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_145049323396269548 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:17,766 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_145049323396269548 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:17,766 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_145049323396269548 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:17,766 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_145049323396269548 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:17,766 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-179423042782344656 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:17,766 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-179423042782344656 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:17,767 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-179423042782344656 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:17,767 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-179423042782344656 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:17,767 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8375126459452884425 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:17,767 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8375126459452884425 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:17,768 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8375126459452884425 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:17,768 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8922866185159813262 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:17,768 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8922866185159813262 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:17,768 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8922866185159813262 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:17,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012	dst=null	perm=null
2013-10-31 16:10:18,217 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-179423042782344656_1131 blk_145049323396269548_1130
2013-10-31 16:10:18,217 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-8922866185159813262_1133 blk_-179423042782344656_1131 blk_145049323396269548_1130 blk_-8375126459452884425_1132
2013-10-31 16:10:18,334 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8922866185159813262_1133 file build/test/data/dfs/data/data3/current/blk_-8922866185159813262 for deletion
2013-10-31 16:10:18,335 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8375126459452884425_1132 file build/test/data/dfs/data/data4/current/blk_-8375126459452884425 for deletion
2013-10-31 16:10:18,335 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8922866185159813262_1133 at file build/test/data/dfs/data/data3/current/blk_-8922866185159813262
2013-10-31 16:10:18,335 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-179423042782344656_1131 file build/test/data/dfs/data/data3/current/blk_-179423042782344656 for deletion
2013-10-31 16:10:18,335 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8375126459452884425_1132 at file build/test/data/dfs/data/data4/current/blk_-8375126459452884425
2013-10-31 16:10:18,336 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-179423042782344656_1131 at file build/test/data/dfs/data/data3/current/blk_-179423042782344656
2013-10-31 16:10:18,336 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_145049323396269548_1130 file build/test/data/dfs/data/data4/current/blk_145049323396269548 for deletion
2013-10-31 16:10:18,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_145049323396269548_1130 at file build/test/data/dfs/data/data4/current/blk_145049323396269548
2013-10-31 16:10:20,708 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000005_0 0.0% cleanup
2013-10-31 16:10:20,709 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000005_0 is done.
2013-10-31 16:10:20,709 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000005_0  was -1
2013-10-31 16:10:20,710 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:20,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-179423042782344656_1131 file build/test/data/dfs/data/data8/current/blk_-179423042782344656 for deletion
2013-10-31 16:10:20,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_145049323396269548_1130 file build/test/data/dfs/data/data7/current/blk_145049323396269548 for deletion
2013-10-31 16:10:20,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-179423042782344656_1131 at file build/test/data/dfs/data/data8/current/blk_-179423042782344656
2013-10-31 16:10:20,938 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_145049323396269548_1130 at file build/test/data/dfs/data/data7/current/blk_145049323396269548
2013-10-31 16:10:21,218 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-8922866185159813262_1133 blk_-179423042782344656_1131 blk_145049323396269548_1130 blk_-8375126459452884425_1132
2013-10-31 16:10:21,218 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-8922866185159813262_1133 blk_-179423042782344656_1131 blk_145049323396269548_1130 blk_-8375126459452884425_1132
2013-10-31 16:10:21,643 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:21,644 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:21,948 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8922866185159813262_1133 file build/test/data/dfs/data/data6/current/blk_-8922866185159813262 for deletion
2013-10-31 16:10:21,948 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8375126459452884425_1132 file build/test/data/dfs/data/data5/current/blk_-8375126459452884425 for deletion
2013-10-31 16:10:21,948 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8922866185159813262_1133 at file build/test/data/dfs/data/data6/current/blk_-8922866185159813262
2013-10-31 16:10:21,948 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-179423042782344656_1131 file build/test/data/dfs/data/data6/current/blk_-179423042782344656 for deletion
2013-10-31 16:10:21,948 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8375126459452884425_1132 at file build/test/data/dfs/data/data5/current/blk_-8375126459452884425
2013-10-31 16:10:21,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-179423042782344656_1131 at file build/test/data/dfs/data/data6/current/blk_-179423042782344656
2013-10-31 16:10:21,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_145049323396269548_1130 file build/test/data/dfs/data/data5/current/blk_145049323396269548 for deletion
2013-10-31 16:10:21,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_145049323396269548_1130 at file build/test/data/dfs/data/data5/current/blk_145049323396269548
2013-10-31 16:10:22,650 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000005_0' has completed task_20131031160444934_0012_m_000005 successfully.
2013-10-31 16:10:22,651 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0012 has completed successfully.
2013-10-31 16:10:22,652 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0012,submitTime=1383235790530,launchTime=1383235790643,firstMapTaskLaunchTime=1383235798603,firstReduceTaskLaunchTime=1383235804617,firstJobSetupTaskLaunchTime=1383235792587,firstJobCleanupTaskLaunchTime=1383235816639,finishTime=1383235822651,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[C96242DE50E048DEA55073ACCDC74EF6/4C0776CD6B3444F6A475F3C309FA23DC] cogrouping/(1/2) ...tform/joinsintocogrouprhs
2013-10-31 16:10:22,658 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6. blk_2505685426499379044_1138
2013-10-31 16:10:22,662 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2505685426499379044_1138 src: /127.0.0.1:54698 dest: /127.0.0.1:41648
2013-10-31 16:10:22,665 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2505685426499379044_1138 src: /127.0.0.1:34594 dest: /127.0.0.1:50942
2013-10-31 16:10:22,666 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2505685426499379044_1138 src: /127.0.0.1:47697 dest: /127.0.0.1:47311
2013-10-31 16:10:22,675 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47697, dest: /127.0.0.1:47311, bytes: 32051, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2505685426499379044_1138, duration: 4774718
2013-10-31 16:10:22,676 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2505685426499379044_1138 terminating
2013-10-31 16:10:22,676 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34594, dest: /127.0.0.1:50942, bytes: 32051, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2505685426499379044_1138, duration: 5599676
2013-10-31 16:10:22,677 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2505685426499379044_1138 terminating
2013-10-31 16:10:22,677 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54698, dest: /127.0.0.1:41648, bytes: 32051, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2505685426499379044_1138, duration: 5786239
2013-10-31 16:10:22,677 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2505685426499379044_1138 terminating
2013-10-31 16:10:22,680 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2505685426499379044_1138 size 32051
2013-10-31 16:10:22,681 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6 from client DFSClient_319165589
2013-10-31 16:10:22,681 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6 is closed by DFSClient_319165589
2013-10-31 16:10:22,681 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2505685426499379044_1138 size 32051
2013-10-31 16:10:22,682 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2505685426499379044_1138 size 32051
2013-10-31 16:10:22,690 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:10:22,691 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000000_0'
2013-10-31 16:10:22,691 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000001_0'
2013-10-31 16:10:22,692 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000005_0'
2013-10-31 16:10:22,693 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000006_0'
2013-10-31 16:10:22,693 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2658578484986837675 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,693 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_r_000000_0'
2013-10-31 16:10:22,693 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2658578484986837675 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,694 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2658578484986837675 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,697 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0012_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:10:22,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012	dst=null	perm=null
2013-10-31 16:10:22,701 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4928171777644314206 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,701 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4928171777644314206 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,701 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4928171777644314206 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,701 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4432548704645493821 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,702 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4432548704645493821 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,702 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4432548704645493821 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,702 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4463643465988243742 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,702 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4463643465988243742 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,703 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4463643465988243742 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,703 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2376389404784738128 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,703 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2376389404784738128 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,703 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2376389404784738128 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,704 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6334597591235643953 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,704 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6334597591235643953 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,704 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6334597591235643953 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,704 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7874678964818902618 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,704 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7874678964818902618 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,705 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7874678964818902618 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,705 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3681265296073978596 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,705 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3681265296073978596 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,705 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3681265296073978596 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787	dst=null	perm=null
2013-10-31 16:10:22,714 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary
2013-10-31 16:10:22,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2013-10-31 16:10:22,734 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:10:22,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2013-10-31 16:10:22,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2013-10-31 16:10:22,738 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54702, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6244668509629146044_1137, duration: 174105
2013-10-31 16:10:22,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2013-10-31 16:10:22,746 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:10:22,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2013-10-31 16:10:22,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2013-10-31 16:10:22,749 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34598, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6244668509629146044_1137, duration: 417798
2013-10-31 16:10:22,750 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintocogrouprhs
2013-10-31 16:10:22,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2013-10-31 16:10:22,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2013-10-31 16:10:22,756 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34599, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6244668509629146044_1137, duration: 389969
2013-10-31 16:10:22,869 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:10:22,869 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:10:22,885 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:10:22,886 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:10:22,886 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:10:22,886 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher"]
2013-10-31 16:10:22,887 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:10:22,887 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:10:22,887 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:10:22,888 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...dpipesplatform/joinhasher
2013-10-31 16:10:22,891 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:10:22,891 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:10:22,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:22,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:10:22,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:22,922 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar. blk_2084801281739929944_1139
2013-10-31 16:10:22,924 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2084801281739929944_1139 src: /127.0.0.1:54705 dest: /127.0.0.1:41648
2013-10-31 16:10:22,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2084801281739929944_1139 src: /127.0.0.1:34670 dest: /127.0.0.1:38271
2013-10-31 16:10:22,927 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2084801281739929944_1139 src: /127.0.0.1:47704 dest: /127.0.0.1:47311
2013-10-31 16:10:22,942 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47704, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2084801281739929944_1139, duration: 11522713
2013-10-31 16:10:22,943 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2084801281739929944_1139 terminating
2013-10-31 16:10:22,943 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34670, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2084801281739929944_1139, duration: 12738970
2013-10-31 16:10:22,944 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2084801281739929944_1139 terminating
2013-10-31 16:10:22,944 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54705, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2084801281739929944_1139, duration: 13924284
2013-10-31 16:10:22,945 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2084801281739929944_1139 terminating
2013-10-31 16:10:22,945 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2084801281739929944_1139 size 238055
2013-10-31 16:10:22,948 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar from client DFSClient_1457307213
2013-10-31 16:10:22,948 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar is closed by DFSClient_1457307213
2013-10-31 16:10:22,949 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2084801281739929944_1139 size 238055
2013-10-31 16:10:22,949 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2084801281739929944_1139 size 238055
2013-10-31 16:10:22,964 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar. New replication is 10
2013-10-31 16:10:22,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar	dst=null	perm=null
2013-10-31 16:10:22,973 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000002_0'
2013-10-31 16:10:22,974 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000003_0'
2013-10-31 16:10:22,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:22,975 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:10:22,980 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:10:22,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:23,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,477 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split. New replication is 10
2013-10-31 16:10:23,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split	dst=null	perm=null
2013-10-31 16:10:23,484 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split. blk_-608843021333253453_1140
2013-10-31 16:10:23,485 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-608843021333253453_1140 src: /127.0.0.1:47705 dest: /127.0.0.1:47311
2013-10-31 16:10:23,487 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-608843021333253453_1140 src: /127.0.0.1:34604 dest: /127.0.0.1:50942
2013-10-31 16:10:23,489 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-608843021333253453_1140 src: /127.0.0.1:34674 dest: /127.0.0.1:38271
2013-10-31 16:10:23,490 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-608843021333253453_1140 src: /127.0.0.1:54711 dest: /127.0.0.1:41648
2013-10-31 16:10:23,494 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54711, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-608843021333253453_1140, duration: 102979
2013-10-31 16:10:23,494 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-608843021333253453_1140 terminating
2013-10-31 16:10:23,494 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-608843021333253453_1140 size 1732
2013-10-31 16:10:23,494 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34674, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-608843021333253453_1140, duration: 897360
2013-10-31 16:10:23,495 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-608843021333253453_1140 size 1732
2013-10-31 16:10:23,495 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-608843021333253453_1140 terminating
2013-10-31 16:10:23,496 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34604, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-608843021333253453_1140, duration: 2080171
2013-10-31 16:10:23,496 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-608843021333253453_1140 terminating
2013-10-31 16:10:23,496 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47705, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-608843021333253453_1140, duration: 2996561
2013-10-31 16:10:23,497 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-608843021333253453_1140 terminating
2013-10-31 16:10:23,498 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-608843021333253453_1140 size 1732
2013-10-31 16:10:23,499 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split from client DFSClient_1457307213
2013-10-31 16:10:23,499 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split is closed by DFSClient_1457307213
2013-10-31 16:10:23,500 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-608843021333253453_1140 size 1732
2013-10-31 16:10:23,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,516 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo. blk_3386068009123988079_1141
2013-10-31 16:10:23,517 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3386068009123988079_1141 src: /127.0.0.1:34676 dest: /127.0.0.1:38271
2013-10-31 16:10:23,519 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3386068009123988079_1141 src: /127.0.0.1:47710 dest: /127.0.0.1:47311
2013-10-31 16:10:23,521 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3386068009123988079_1141 src: /127.0.0.1:34609 dest: /127.0.0.1:50942
2013-10-31 16:10:23,524 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34609, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3386068009123988079_1141, duration: 65885
2013-10-31 16:10:23,524 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3386068009123988079_1141 terminating
2013-10-31 16:10:23,524 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47710, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3386068009123988079_1141, duration: 829930
2013-10-31 16:10:23,525 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3386068009123988079_1141 terminating
2013-10-31 16:10:23,525 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3386068009123988079_1141 size 183
2013-10-31 16:10:23,525 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34676, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3386068009123988079_1141, duration: 1664939
2013-10-31 16:10:23,526 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3386068009123988079_1141 size 183
2013-10-31 16:10:23,527 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3386068009123988079_1141 terminating
2013-10-31 16:10:23,529 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:10:23,530 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:10:23,530 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3386068009123988079_1141 size 183
2013-10-31 16:10:23,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,560 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml. blk_1041963905236869909_1142
2013-10-31 16:10:23,561 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1041963905236869909_1142 src: /127.0.0.1:34610 dest: /127.0.0.1:50942
2013-10-31 16:10:23,563 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1041963905236869909_1142 src: /127.0.0.1:54716 dest: /127.0.0.1:41648
2013-10-31 16:10:23,564 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1041963905236869909_1142 src: /127.0.0.1:47714 dest: /127.0.0.1:47311
2013-10-31 16:10:23,567 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47714, dest: /127.0.0.1:47311, bytes: 28715, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1041963905236869909_1142, duration: 88149
2013-10-31 16:10:23,567 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1041963905236869909_1142 terminating
2013-10-31 16:10:23,568 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54716, dest: /127.0.0.1:41648, bytes: 28715, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1041963905236869909_1142, duration: 831431
2013-10-31 16:10:23,568 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1041963905236869909_1142 terminating
2013-10-31 16:10:23,569 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34610, dest: /127.0.0.1:50942, bytes: 28715, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1041963905236869909_1142, duration: 1668963
2013-10-31 16:10:23,569 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1041963905236869909_1142 terminating
2013-10-31 16:10:23,571 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1041963905236869909_1142 size 28715
2013-10-31 16:10:23,572 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1041963905236869909_1142 size 28715
2013-10-31 16:10:23,572 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1041963905236869909_1142 size 28715
2013-10-31 16:10:23,620 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000004_0'
2013-10-31 16:10:23,646 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0012
2013-10-31 16:10:23,647 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0012 being deleted.
2013-10-31 16:10:23,736 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8922866185159813262_1133 file build/test/data/dfs/data/data2/current/blk_-8922866185159813262 for deletion
2013-10-31 16:10:23,736 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8375126459452884425_1132 file build/test/data/dfs/data/data1/current/blk_-8375126459452884425 for deletion
2013-10-31 16:10:23,736 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8922866185159813262_1133 at file build/test/data/dfs/data/data2/current/blk_-8922866185159813262
2013-10-31 16:10:23,736 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-179423042782344656_1131 file build/test/data/dfs/data/data2/current/blk_-179423042782344656 for deletion
2013-10-31 16:10:23,737 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8375126459452884425_1132 at file build/test/data/dfs/data/data1/current/blk_-8375126459452884425
2013-10-31 16:10:23,737 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-179423042782344656_1131 at file build/test/data/dfs/data/data2/current/blk_-179423042782344656
2013-10-31 16:10:23,737 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_145049323396269548_1130 file build/test/data/dfs/data/data1/current/blk_145049323396269548 for deletion
2013-10-31 16:10:23,738 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_145049323396269548_1130 at file build/test/data/dfs/data/data1/current/blk_145049323396269548
2013-10-31 16:10:23,971 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml from client DFSClient_1457307213
2013-10-31 16:10:23,972 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml is closed by DFSClient_1457307213
2013-10-31 16:10:23,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml	dst=null	perm=null
2013-10-31 16:10:23,987 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54719, bytes: 28943, op: HDFS_READ, cliID: DFSClient_710295022, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1041963905236869909_1142, duration: 389093
2013-10-31 16:10:24,006 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0013: nMaps=5 nReduces=0 max=-1
2013-10-31 16:10:24,006 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0013 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:10:24,006 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0013
2013-10-31 16:10:24,007 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0013	RESULT=SUCCESS
2013-10-31 16:10:24,007 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0013
2013-10-31 16:10:24,009 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0013
2013-10-31 16:10:24,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:24,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:24,039 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_conf.xml. blk_-1501954730110881669_1144
2013-10-31 16:10:24,041 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1501954730110881669_1144 src: /127.0.0.1:34615 dest: /127.0.0.1:50942
2013-10-31 16:10:24,042 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1501954730110881669_1144 src: /127.0.0.1:47718 dest: /127.0.0.1:47311
2013-10-31 16:10:24,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1501954730110881669_1144 src: /127.0.0.1:54722 dest: /127.0.0.1:41648
2013-10-31 16:10:24,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54722, dest: /127.0.0.1:41648, bytes: 28780, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1501954730110881669_1144, duration: 624861
2013-10-31 16:10:24,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1501954730110881669_1144 terminating
2013-10-31 16:10:24,049 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47718, dest: /127.0.0.1:47311, bytes: 28780, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1501954730110881669_1144, duration: 1904708
2013-10-31 16:10:24,049 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1501954730110881669_1144 terminating
2013-10-31 16:10:24,050 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34615, dest: /127.0.0.1:50942, bytes: 28780, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1501954730110881669_1144, duration: 2302329
2013-10-31 16:10:24,050 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1501954730110881669_1144 terminating
2013-10-31 16:10:24,053 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1501954730110881669_1144 size 28780
2013-10-31 16:10:24,053 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1501954730110881669_1144 size 28780
2013-10-31 16:10:24,053 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1501954730110881669_1144 size 28780
2013-10-31 16:10:24,219 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_2084801281739929944_1139 to datanode(s) 127.0.0.1:50942
2013-10-31 16:10:24,219 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_4928171777644314206_1129 blk_2658578484986837675_1136 blk_-4432548704645493821_1122 blk_4463643465988243742_1125 blk_6334597591235643953_1128
2013-10-31 16:10:24,220 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-2376389404784738128_1124 blk_4928171777644314206_1129 blk_2658578484986837675_1136 blk_-4432548704645493821_1122 blk_-3681265296073978596_1128 blk_-7874678964818902618_1128 blk_6334597591235643953_1128
2013-10-31 16:10:24,335 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_2084801281739929944_1139 to 127.0.0.1:50942 
2013-10-31 16:10:24,337 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2084801281739929944_1139 src: /127.0.0.1:34618 dest: /127.0.0.1:50942
2013-10-31 16:10:24,338 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_2084801281739929944_1139 to /127.0.0.1:50942
2013-10-31 16:10:24,341 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_2084801281739929944_1139 src: /127.0.0.1:34618 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:10:24,345 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2084801281739929944_1139 size 238055
2013-10-31 16:10:24,452 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_conf.xml from client DFSClient_710295022
2013-10-31 16:10:24,453 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_conf.xml is closed by DFSClient_710295022
2013-10-31 16:10:24,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:24,467 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken. blk_-6351416155261990527_1145
2013-10-31 16:10:24,468 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6351416155261990527_1145 src: /127.0.0.1:47721 dest: /127.0.0.1:47311
2013-10-31 16:10:24,470 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6351416155261990527_1145 src: /127.0.0.1:34689 dest: /127.0.0.1:38271
2013-10-31 16:10:24,471 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6351416155261990527_1145 src: /127.0.0.1:34621 dest: /127.0.0.1:50942
2013-10-31 16:10:24,474 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34621, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6351416155261990527_1145, duration: 65254
2013-10-31 16:10:24,474 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6351416155261990527_1145 terminating
2013-10-31 16:10:24,475 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34689, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6351416155261990527_1145, duration: 843190
2013-10-31 16:10:24,475 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6351416155261990527_1145 terminating
2013-10-31 16:10:24,476 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47721, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6351416155261990527_1145, duration: 1689699
2013-10-31 16:10:24,477 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6351416155261990527_1145 terminating
2013-10-31 16:10:24,477 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6351416155261990527_1145 size 116
2013-10-31 16:10:24,479 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken from client DFSClient_1457307213
2013-10-31 16:10:24,479 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken is closed by DFSClient_1457307213
2013-10-31 16:10:24,479 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6351416155261990527_1145 size 116
2013-10-31 16:10:24,480 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6351416155261990527_1145 size 116
2013-10-31 16:10:24,483 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken
2013-10-31 16:10:24,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:10:24,487 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47724, bytes: 187, op: HDFS_READ, cliID: DFSClient_710295022, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3386068009123988079_1141, duration: 262562
2013-10-31 16:10:24,489 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0013 = 19. Number of splits = 5
2013-10-31 16:10:24,489 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,489 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,490 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,490 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,490 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,490 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,492 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,492 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,492 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,492 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,493 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0013 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:10:24,493 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0013 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:10:24,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4432548704645493821_1122 file build/test/data/dfs/data/data6/current/blk_-4432548704645493821 for deletion
2013-10-31 16:10:24,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2658578484986837675_1136 file build/test/data/dfs/data/data6/current/blk_2658578484986837675 for deletion
2013-10-31 16:10:24,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4432548704645493821_1122 at file build/test/data/dfs/data/data6/current/blk_-4432548704645493821
2013-10-31 16:10:24,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4463643465988243742_1125 file build/test/data/dfs/data/data5/current/blk_4463643465988243742 for deletion
2013-10-31 16:10:24,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2658578484986837675_1136 at file build/test/data/dfs/data/data6/current/blk_2658578484986837675
2013-10-31 16:10:24,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4928171777644314206_1129 file build/test/data/dfs/data/data5/current/blk_4928171777644314206 for deletion
2013-10-31 16:10:24,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4463643465988243742_1125 at file build/test/data/dfs/data/data5/current/blk_4463643465988243742
2013-10-31 16:10:24,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6334597591235643953_1128 file build/test/data/dfs/data/data6/current/blk_6334597591235643953 for deletion
2013-10-31 16:10:24,951 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4928171777644314206_1129 at file build/test/data/dfs/data/data5/current/blk_4928171777644314206
2013-10-31 16:10:24,951 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6334597591235643953_1128 at file build/test/data/dfs/data/data6/current/blk_6334597591235643953
2013-10-31 16:10:25,698 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0013_m_000006_0' to tip task_20131031160444934_0013_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:25,704 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:10:25,704 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000006_0 which needs 1 slots
2013-10-31 16:10:25,704 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000006_0 which needs 1 slots
2013-10-31 16:10:25,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken	dst=null	perm=null
2013-10-31 16:10:25,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34623, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6351416155261990527_1145, duration: 293552
2013-10-31 16:10:25,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml	dst=null	perm=null
2013-10-31 16:10:25,723 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54730, bytes: 28943, op: HDFS_READ, cliID: DFSClient_253800261, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1041963905236869909_1142, duration: 391575
2013-10-31 16:10:25,772 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:25,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar	dst=null	perm=null
2013-10-31 16:10:25,806 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54731, bytes: 239915, op: HDFS_READ, cliID: DFSClient_253800261, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2084801281739929944_1139, duration: 1330924
2013-10-31 16:10:25,903 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0012_m_-1151686836
2013-10-31 16:10:25,909 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16862 with signal TERM. Exit code 0
2013-10-31 16:10:25,909 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_-954554037
2013-10-31 16:10:25,910 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_-954554037 spawned.
2013-10-31 16:10:25,911 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000006_0/taskjvm.sh
2013-10-31 16:10:25,995 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:25,995 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:25,995 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:25,995 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_-1151686836 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:26,939 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7874678964818902618_1128 file build/test/data/dfs/data/data7/current/blk_-7874678964818902618 for deletion
2013-10-31 16:10:26,939 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4432548704645493821_1122 file build/test/data/dfs/data/data7/current/blk_-4432548704645493821 for deletion
2013-10-31 16:10:26,939 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7874678964818902618_1128 at file build/test/data/dfs/data/data7/current/blk_-7874678964818902618
2013-10-31 16:10:26,939 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3681265296073978596_1128 file build/test/data/dfs/data/data8/current/blk_-3681265296073978596 for deletion
2013-10-31 16:10:26,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4432548704645493821_1122 at file build/test/data/dfs/data/data7/current/blk_-4432548704645493821
2013-10-31 16:10:26,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2376389404784738128_1124 file build/test/data/dfs/data/data8/current/blk_-2376389404784738128 for deletion
2013-10-31 16:10:26,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3681265296073978596_1128 at file build/test/data/dfs/data/data8/current/blk_-3681265296073978596
2013-10-31 16:10:26,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2658578484986837675_1136 file build/test/data/dfs/data/data8/current/blk_2658578484986837675 for deletion
2013-10-31 16:10:26,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2376389404784738128_1124 at file build/test/data/dfs/data/data8/current/blk_-2376389404784738128
2013-10-31 16:10:26,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4928171777644314206_1129 file build/test/data/dfs/data/data8/current/blk_4928171777644314206 for deletion
2013-10-31 16:10:26,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2658578484986837675_1136 at file build/test/data/dfs/data/data8/current/blk_2658578484986837675
2013-10-31 16:10:26,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6334597591235643953_1128 file build/test/data/dfs/data/data7/current/blk_6334597591235643953 for deletion
2013-10-31 16:10:26,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4928171777644314206_1129 at file build/test/data/dfs/data/data8/current/blk_4928171777644314206
2013-10-31 16:10:26,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6334597591235643953_1128 at file build/test/data/dfs/data/data7/current/blk_6334597591235643953
2013-10-31 16:10:27,220 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-2376389404784738128_1124 blk_4928171777644314206_1129 blk_-3681265296073978596_1128 blk_-7874678964818902618_1128 blk_4463643465988243742_1125
2013-10-31 16:10:27,220 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-2376389404784738128_1124 blk_2658578484986837675_1136 blk_-4432548704645493821_1122 blk_-3681265296073978596_1128 blk_-7874678964818902618_1128 blk_4463643465988243742_1125 blk_6334597591235643953_1128
2013-10-31 16:10:27,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7874678964818902618_1128 file build/test/data/dfs/data/data3/current/blk_-7874678964818902618 for deletion
2013-10-31 16:10:27,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3681265296073978596_1128 file build/test/data/dfs/data/data4/current/blk_-3681265296073978596 for deletion
2013-10-31 16:10:27,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7874678964818902618_1128 at file build/test/data/dfs/data/data3/current/blk_-7874678964818902618
2013-10-31 16:10:27,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3681265296073978596_1128 at file build/test/data/dfs/data/data4/current/blk_-3681265296073978596
2013-10-31 16:10:27,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2376389404784738128_1124 file build/test/data/dfs/data/data3/current/blk_-2376389404784738128 for deletion
2013-10-31 16:10:27,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4463643465988243742_1125 file build/test/data/dfs/data/data4/current/blk_4463643465988243742 for deletion
2013-10-31 16:10:27,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2376389404784738128_1124 at file build/test/data/dfs/data/data3/current/blk_-2376389404784738128
2013-10-31 16:10:27,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4928171777644314206_1129 file build/test/data/dfs/data/data3/current/blk_4928171777644314206 for deletion
2013-10-31 16:10:27,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4463643465988243742_1125 at file build/test/data/dfs/data/data4/current/blk_4463643465988243742
2013-10-31 16:10:27,339 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4928171777644314206_1129 at file build/test/data/dfs/data/data3/current/blk_4928171777644314206
2013-10-31 16:10:27,538 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_-954554037 given task: attempt_20131031160444934_0013_m_000006_0
2013-10-31 16:10:27,694 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0012
2013-10-31 16:10:27,694 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0012_m_000005_0 not found in cache
2013-10-31 16:10:27,695 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0012 for user-log deletion with retainTimeStamp:1383322227695
2013-10-31 16:10:27,823 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_r_1984937276 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:27,827 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17166 with signal TERM. Exit code 0
2013-10-31 16:10:27,974 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:27,974 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:27,974 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:27,974 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_r_1984937276 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:27,974 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0012
2013-10-31 16:10:27,975 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0012 for user-log deletion with retainTimeStamp:1383322227975
2013-10-31 16:10:28,051 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_m_1792759549 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:28,058 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16926 with signal TERM. Exit code 0
2013-10-31 16:10:28,060 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_m_-1393587902 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:28,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:28,065 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16956 with signal TERM. Exit code 0
2013-10-31 16:10:28,262 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:28,262 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:28,263 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:28,263 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:28,262 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:28,263 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:28,263 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_1792759549 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:28,264 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_-1393587902 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:28,621 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0012
2013-10-31 16:10:28,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0012 for user-log deletion with retainTimeStamp:1383322228621
2013-10-31 16:10:28,739 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_m_-2020008089 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:28,749 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16682 with signal TERM. Exit code 0
2013-10-31 16:10:28,941 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:28,941 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:28,941 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:28,941 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_-2020008089 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:10:29,528 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_m_-307168687 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:29,538 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17027 with signal TERM. Exit code 0
2013-10-31 16:10:29,738 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7874678964818902618_1128 file build/test/data/dfs/data/data2/current/blk_-7874678964818902618 for deletion
2013-10-31 16:10:29,738 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4432548704645493821_1122 file build/test/data/dfs/data/data2/current/blk_-4432548704645493821 for deletion
2013-10-31 16:10:29,738 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7874678964818902618_1128 at file build/test/data/dfs/data/data2/current/blk_-7874678964818902618
2013-10-31 16:10:29,739 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3681265296073978596_1128 file build/test/data/dfs/data/data1/current/blk_-3681265296073978596 for deletion
2013-10-31 16:10:29,739 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4432548704645493821_1122 at file build/test/data/dfs/data/data2/current/blk_-4432548704645493821
2013-10-31 16:10:29,739 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2376389404784738128_1124 file build/test/data/dfs/data/data2/current/blk_-2376389404784738128 for deletion
2013-10-31 16:10:29,739 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3681265296073978596_1128 at file build/test/data/dfs/data/data1/current/blk_-3681265296073978596
2013-10-31 16:10:29,740 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2376389404784738128_1124 at file build/test/data/dfs/data/data2/current/blk_-2376389404784738128
2013-10-31 16:10:29,739 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2658578484986837675_1136 file build/test/data/dfs/data/data1/current/blk_2658578484986837675 for deletion
2013-10-31 16:10:29,740 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4463643465988243742_1125 file build/test/data/dfs/data/data1/current/blk_4463643465988243742 for deletion
2013-10-31 16:10:29,740 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2658578484986837675_1136 at file build/test/data/dfs/data/data1/current/blk_2658578484986837675
2013-10-31 16:10:29,740 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6334597591235643953_1128 file build/test/data/dfs/data/data2/current/blk_6334597591235643953 for deletion
2013-10-31 16:10:29,741 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4463643465988243742_1125 at file build/test/data/dfs/data/data1/current/blk_4463643465988243742
2013-10-31 16:10:29,741 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6334597591235643953_1128 at file build/test/data/dfs/data/data2/current/blk_6334597591235643953
2013-10-31 16:10:29,777 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:29,777 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:29,777 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:29,777 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_-307168687 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:30,991 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000006_0 0.0% setup
2013-10-31 16:10:30,993 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000006_0 is done.
2013-10-31 16:10:30,994 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000006_0  was -1
2013-10-31 16:10:30,994 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:31,710 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000006_0' has completed task_20131031160444934_0013_m_000006 successfully.
2013-10-31 16:10:31,714 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000000_0' to tip task_20131031160444934_0013_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:31,715 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000000
2013-10-31 16:10:31,716 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000001_0' to tip task_20131031160444934_0013_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:31,716 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000001
2013-10-31 16:10:31,718 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:10:31,719 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:10:31,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000000_0 which needs 1 slots
2013-10-31 16:10:31,720 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000000_0 which needs 1 slots
2013-10-31 16:10:31,720 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000001_0 which needs 1 slots
2013-10-31 16:10:31,720 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0013_m_000001_0 which needs 1 slots
2013-10-31 16:10:31,759 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_1014058939
2013-10-31 16:10:31,760 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_1014058939 spawned.
2013-10-31 16:10:31,761 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000000_0/taskjvm.sh
2013-10-31 16:10:31,765 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0013/attempt_20131031160444934_0013_m_000001_0. Attempting to reuse: jvm_20131031160444934_0013_m_-954554037
2013-10-31 16:10:31,981 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000002_0' to tip task_20131031160444934_0013_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:10:31,981 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000002
2013-10-31 16:10:31,981 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000003_0' to tip task_20131031160444934_0013_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:10:31,981 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000003
2013-10-31 16:10:31,982 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:10:31,984 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:10:31,984 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000002_0 which needs 1 slots
2013-10-31 16:10:31,984 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000002_0 which needs 1 slots
2013-10-31 16:10:31,984 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000003_0 which needs 1 slots
2013-10-31 16:10:31,984 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0013_m_000003_0 which needs 1 slots
2013-10-31 16:10:31,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken	dst=null	perm=null
2013-10-31 16:10:31,992 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34699, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6351416155261990527_1145, duration: 291395
2013-10-31 16:10:31,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml	dst=null	perm=null
2013-10-31 16:10:32,002 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47734, bytes: 28943, op: HDFS_READ, cliID: DFSClient_1455276149, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1041963905236869909_1142, duration: 368995
2013-10-31 16:10:32,022 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:32,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar	dst=null	perm=null
2013-10-31 16:10:32,035 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54738, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1455276149, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2084801281739929944_1139, duration: 709650
2013-10-31 16:10:32,089 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_299302560
2013-10-31 16:10:32,089 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_299302560 spawned.
2013-10-31 16:10:32,089 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_-544706238
2013-10-31 16:10:32,090 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_-544706238 spawned.
2013-10-31 16:10:32,091 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000002_0/taskjvm.sh
2013-10-31 16:10:32,091 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000003_0/taskjvm.sh
2013-10-31 16:10:32,108 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_-954554037 given task: attempt_20131031160444934_0013_m_000001_0
2013-10-31 16:10:32,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split	dst=null	perm=null
2013-10-31 16:10:32,211 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47737, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-608843021333253453_1140, duration: 166598
2013-10-31 16:10:32,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:32,252 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34705, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 127301
2013-10-31 16:10:32,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:32,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:32,620 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_1014058939 given task: attempt_20131031160444934_0013_m_000000_0
2013-10-31 16:10:32,629 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000004_0' to tip task_20131031160444934_0013_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:10:32,629 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000004
2013-10-31 16:10:32,630 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:10:32,630 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000004_0 which needs 1 slots
2013-10-31 16:10:32,630 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000004_0 which needs 1 slots
2013-10-31 16:10:32,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken	dst=null	perm=null
2013-10-31 16:10:32,634 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47740, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6351416155261990527_1145, duration: 142931
2013-10-31 16:10:32,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml	dst=null	perm=null
2013-10-31 16:10:32,639 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54745, bytes: 28943, op: HDFS_READ, cliID: DFSClient_-1738923227, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1041963905236869909_1142, duration: 153238
2013-10-31 16:10:32,652 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:32,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar	dst=null	perm=null
2013-10-31 16:10:32,666 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34641, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1738923227, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2084801281739929944_1139, duration: 634064
2013-10-31 16:10:32,736 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_-28830232
2013-10-31 16:10:32,737 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_-28830232 spawned.
2013-10-31 16:10:32,739 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000004_0/taskjvm.sh
2013-10-31 16:10:33,101 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_299302560 given task: attempt_20131031160444934_0013_m_000002_0
2013-10-31 16:10:33,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:33,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:33,118 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34644, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 136022
2013-10-31 16:10:33,127 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001. blk_-8296089989830320846_1146
2013-10-31 16:10:33,142 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8296089989830320846_1146 src: /127.0.0.1:54751 dest: /127.0.0.1:41648
2013-10-31 16:10:33,143 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8296089989830320846_1146 src: /127.0.0.1:34647 dest: /127.0.0.1:50942
2013-10-31 16:10:33,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8296089989830320846_1146 src: /127.0.0.1:34717 dest: /127.0.0.1:38271
2013-10-31 16:10:33,146 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34717, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8296089989830320846_1146, duration: 1810427
2013-10-31 16:10:33,147 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8296089989830320846_1146 terminating
2013-10-31 16:10:33,147 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34647, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8296089989830320846_1146, duration: 2077904
2013-10-31 16:10:33,147 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8296089989830320846_1146 terminating
2013-10-31 16:10:33,147 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8296089989830320846_1146 size 8
2013-10-31 16:10:33,147 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54751, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8296089989830320846_1146, duration: 2696287
2013-10-31 16:10:33,148 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8296089989830320846_1146 terminating
2013-10-31 16:10:33,149 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0013_m_000001_0
2013-10-31 16:10:33,150 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0013_m_000001_0
2013-10-31 16:10:33,151 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8296089989830320846_1146 size 8
2013-10-31 16:10:33,152 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8296089989830320846_1146 size 8
2013-10-31 16:10:33,187 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:33,187 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000001_0 0.0% 
2013-10-31 16:10:33,189 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_-544706238 given task: attempt_20131031160444934_0013_m_000003_0
2013-10-31 16:10:33,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split	dst=null	perm=null
2013-10-31 16:10:33,214 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54754, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-608843021333253453_1140, duration: 162637
2013-10-31 16:10:33,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:33,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:33,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:33,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split	dst=null	perm=null
2013-10-31 16:10:33,615 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34725, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-608843021333253453_1140, duration: 174883
2013-10-31 16:10:33,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:33,655 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34726, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 137357
2013-10-31 16:10:33,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:33,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split	dst=null	perm=null
2013-10-31 16:10:33,687 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34658, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-608843021333253453_1140, duration: 157146
2013-10-31 16:10:33,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:33,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:33,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34728, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 129650
2013-10-31 16:10:33,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:33,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:33,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:33,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:33,766 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47762, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 128730
2013-10-31 16:10:33,768 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34661, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 102135
2013-10-31 16:10:33,775 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000. blk_-8480038614496047175_1149
2013-10-31 16:10:33,777 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_-28830232 given task: attempt_20131031160444934_0013_m_000004_0
2013-10-31 16:10:33,796 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8480038614496047175_1149 src: /127.0.0.1:34731 dest: /127.0.0.1:38271
2013-10-31 16:10:33,797 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8480038614496047175_1149 src: /127.0.0.1:54768 dest: /127.0.0.1:41648
2013-10-31 16:10:33,798 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8480038614496047175_1149 src: /127.0.0.1:47766 dest: /127.0.0.1:47311
2013-10-31 16:10:33,800 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47766, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8480038614496047175_1149, duration: 1293267
2013-10-31 16:10:33,800 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8480038614496047175_1149 terminating
2013-10-31 16:10:33,800 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8480038614496047175_1149 size 8
2013-10-31 16:10:33,800 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54768, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8480038614496047175_1149, duration: 1545845
2013-10-31 16:10:33,801 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8480038614496047175_1149 size 8
2013-10-31 16:10:33,801 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8480038614496047175_1149 terminating
2013-10-31 16:10:33,801 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34731, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8480038614496047175_1149, duration: 1979264
2013-10-31 16:10:33,801 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8480038614496047175_1149 terminating
2013-10-31 16:10:33,802 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0013_m_000000_0
2013-10-31 16:10:33,802 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0013_m_000000_0
2013-10-31 16:10:33,804 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8480038614496047175_1149 size 8
2013-10-31 16:10:33,847 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:33,847 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000000_0 0.0% 
2013-10-31 16:10:34,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:34,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:34,176 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47767, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 143944
2013-10-31 16:10:34,184 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002. blk_5790387209777498875_1149
2013-10-31 16:10:34,206 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5790387209777498875_1149 src: /127.0.0.1:34666 dest: /127.0.0.1:50942
2013-10-31 16:10:34,207 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5790387209777498875_1149 src: /127.0.0.1:47770 dest: /127.0.0.1:47311
2013-10-31 16:10:34,208 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5790387209777498875_1149 src: /127.0.0.1:54774 dest: /127.0.0.1:41648
2013-10-31 16:10:34,211 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54774, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5790387209777498875_1149, duration: 2112653
2013-10-31 16:10:34,211 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5790387209777498875_1149 terminating
2013-10-31 16:10:34,211 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47770, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5790387209777498875_1149, duration: 2350066
2013-10-31 16:10:34,211 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5790387209777498875_1149 terminating
2013-10-31 16:10:34,211 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34666, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5790387209777498875_1149, duration: 2745536
2013-10-31 16:10:34,212 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5790387209777498875_1149 terminating
2013-10-31 16:10:34,214 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5790387209777498875_1149 size 8
2013-10-31 16:10:34,214 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5790387209777498875_1149 size 8
2013-10-31 16:10:34,216 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5790387209777498875_1149 size 8
2013-10-31 16:10:34,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:34,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:34,235 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34670, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 116252
2013-10-31 16:10:34,244 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003. blk_-4333307790222333982_1149
2013-10-31 16:10:34,264 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4333307790222333982_1149 src: /127.0.0.1:34671 dest: /127.0.0.1:50942
2013-10-31 16:10:34,265 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4333307790222333982_1149 src: /127.0.0.1:34741 dest: /127.0.0.1:38271
2013-10-31 16:10:34,266 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4333307790222333982_1149 src: /127.0.0.1:54778 dest: /127.0.0.1:41648
2013-10-31 16:10:34,268 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54778, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4333307790222333982_1149, duration: 917796
2013-10-31 16:10:34,268 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4333307790222333982_1149 terminating
2013-10-31 16:10:34,268 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34741, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4333307790222333982_1149, duration: 1260866
2013-10-31 16:10:34,269 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4333307790222333982_1149 terminating
2013-10-31 16:10:34,269 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34671, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4333307790222333982_1149, duration: 1694495
2013-10-31 16:10:34,269 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4333307790222333982_1149 terminating
2013-10-31 16:10:34,271 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4333307790222333982_1149 size 8
2013-10-31 16:10:34,271 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4333307790222333982_1149 size 8
2013-10-31 16:10:34,272 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4333307790222333982_1149 size 8
2013-10-31 16:10:34,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split	dst=null	perm=null
2013-10-31 16:10:34,280 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34674, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-608843021333253453_1140, duration: 150915
2013-10-31 16:10:34,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:34,320 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47777, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 251846
2013-10-31 16:10:34,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:34,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:34,614 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0013_m_000002_0
2013-10-31 16:10:34,614 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0013_m_000002_0
2013-10-31 16:10:34,661 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:34,662 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000002_0 0.0% 
2013-10-31 16:10:34,670 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0013_m_000003_0
2013-10-31 16:10:34,671 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0013_m_000003_0
2013-10-31 16:10:34,720 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000000_0
2013-10-31 16:10:34,720 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000001_0
2013-10-31 16:10:34,726 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:34,726 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000003_0 0.0% 
2013-10-31 16:10:34,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:34,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:34,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0	dst=null	perm=null
2013-10-31 16:10:34,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:34,855 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34676, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 145990
2013-10-31 16:10:34,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:34,864 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004. blk_-3746207844407953251_1150
2013-10-31 16:10:34,886 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3746207844407953251_1150 src: /127.0.0.1:34746 dest: /127.0.0.1:38271
2013-10-31 16:10:34,888 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3746207844407953251_1150 src: /127.0.0.1:34678 dest: /127.0.0.1:50942
2013-10-31 16:10:34,889 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3746207844407953251_1150 src: /127.0.0.1:54784 dest: /127.0.0.1:41648
2013-10-31 16:10:34,892 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54784, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3746207844407953251_1150, duration: 1533507
2013-10-31 16:10:34,892 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3746207844407953251_1150 terminating
2013-10-31 16:10:34,892 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34678, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3746207844407953251_1150, duration: 1534014
2013-10-31 16:10:34,893 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3746207844407953251_1150 size 8
2013-10-31 16:10:34,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3746207844407953251_1150 terminating
2013-10-31 16:10:34,893 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34746, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3746207844407953251_1150, duration: 2509870
2013-10-31 16:10:34,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3746207844407953251_1150 terminating
2013-10-31 16:10:34,895 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0013_m_000004_0
2013-10-31 16:10:34,895 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0013_m_000004_0
2013-10-31 16:10:34,895 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3746207844407953251_1150 size 8
2013-10-31 16:10:34,897 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3746207844407953251_1150 size 8
2013-10-31 16:10:34,987 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000002_0
2013-10-31 16:10:34,988 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000003_0
2013-10-31 16:10:36,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0	dst=null	perm=null
2013-10-31 16:10:36,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0	dst=null	perm=null
2013-10-31 16:10:36,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:36,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:36,720 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0013_m_000006_0
2013-10-31 16:10:36,720 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0013_m_000006_0
2013-10-31 16:10:36,720 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000006_0 not found in cache
2013-10-31 16:10:37,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0	dst=null	perm=null
2013-10-31 16:10:37,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:37,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0	dst=null	perm=null
2013-10-31 16:10:37,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:37,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:37,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:37,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0	dst=null	perm=null
2013-10-31 16:10:37,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0	dst=null	perm=null
2013-10-31 16:10:37,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0	dst=null	perm=null
2013-10-31 16:10:37,528 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:37,529 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000004_0 0.0% 
2013-10-31 16:10:38,207 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:10:38,210 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:10:38,210 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000001_0 is done.
2013-10-31 16:10:38,211 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000001_0  was -1
2013-10-31 16:10:38,211 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:10:38,637 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000004_0
2013-10-31 16:10:39,177 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:10:39,181 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:10:39,182 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000000_0 is done.
2013-10-31 16:10:39,182 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000000_0  was -1
2013-10-31 16:10:39,183 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:39,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0	dst=null	perm=null
2013-10-31 16:10:39,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:39,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:39,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0	dst=null	perm=null
2013-10-31 16:10:39,591 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:10:39,594 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:10:39,595 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000002_0 is done.
2013-10-31 16:10:39,595 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000002_0  was -1
2013-10-31 16:10:39,595 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:10:39,655 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:10:39,658 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:10:39,659 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000003_0 is done.
2013-10-31 16:10:39,659 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000003_0  was -1
2013-10-31 16:10:39,660 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:39,848 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:10:39,858 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,863 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,869 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,874 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,879 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,885 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,885 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:10:40,254 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:10:40,256 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:10:40,257 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000004_0 is done.
2013-10-31 16:10:40,257 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000004_0  was -1
2013-10-31 16:10:40,258 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:40,726 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000000_0' has completed task_20131031160444934_0013_m_000000 successfully.
2013-10-31 16:10:40,728 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000001_0' has completed task_20131031160444934_0013_m_000001 successfully.
2013-10-31 16:10:40,995 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000002_0' has completed task_20131031160444934_0013_m_000002 successfully.
2013-10-31 16:10:40,996 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000003_0' has completed task_20131031160444934_0013_m_000003 successfully.
2013-10-31 16:10:41,009 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 109 raw values into 2 aggregated values, total 2
2013-10-31 16:10:41,641 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000004_0' has completed task_20131031160444934_0013_m_000004 successfully.
2013-10-31 16:10:41,645 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0013_m_000005_0' to tip task_20131031160444934_0013_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:10:41,647 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:10:41,648 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000005_0 which needs 1 slots
2013-10-31 16:10:41,648 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000005_0 which needs 1 slots
2013-10-31 16:10:41,682 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_1197284086
2013-10-31 16:10:41,683 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_1197284086 spawned.
2013-10-31 16:10:41,685 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000005_0/taskjvm.sh
2013-10-31 16:10:43,318 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_1197284086 given task: attempt_20131031160444934_0013_m_000005_0
2013-10-31 16:10:43,825 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000005_0 0.0% 
2013-10-31 16:10:43,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary	dst=null	perm=null
2013-10-31 16:10:43,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:43,844 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_SUCCESS from client DFSClient_attempt_20131031160444934_0013_m_000005_0
2013-10-31 16:10:43,844 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0013_m_000005_0
2013-10-31 16:10:43,848 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2084801281739929944 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:43,848 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2084801281739929944 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:43,848 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2084801281739929944 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:43,848 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2084801281739929944 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:43,848 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-608843021333253453 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:43,848 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-608843021333253453 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:43,848 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-608843021333253453 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:43,849 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-608843021333253453 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:43,849 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3386068009123988079 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:43,849 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3386068009123988079 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:43,849 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3386068009123988079 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:43,849 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1041963905236869909 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:43,849 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1041963905236869909 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:43,849 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1041963905236869909 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:43,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013	dst=null	perm=null
2013-10-31 16:10:45,223 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_2084801281739929944_1139 blk_-608843021333253453_1140 blk_1041963905236869909_1142
2013-10-31 16:10:45,224 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_2084801281739929944_1139 blk_-608843021333253453_1140 blk_1041963905236869909_1142 blk_3386068009123988079_1141
2013-10-31 16:10:45,956 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-608843021333253453_1140 file build/test/data/dfs/data/data5/current/blk_-608843021333253453 for deletion
2013-10-31 16:10:45,956 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1041963905236869909_1142 file build/test/data/dfs/data/data6/current/blk_1041963905236869909 for deletion
2013-10-31 16:10:45,956 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-608843021333253453_1140 at file build/test/data/dfs/data/data5/current/blk_-608843021333253453
2013-10-31 16:10:45,956 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2084801281739929944_1139 file build/test/data/dfs/data/data6/current/blk_2084801281739929944 for deletion
2013-10-31 16:10:45,957 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1041963905236869909_1142 at file build/test/data/dfs/data/data6/current/blk_1041963905236869909
2013-10-31 16:10:45,957 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2084801281739929944_1139 at file build/test/data/dfs/data/data6/current/blk_2084801281739929944
2013-10-31 16:10:46,759 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000005_0 0.0% cleanup
2013-10-31 16:10:46,761 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000005_0 is done.
2013-10-31 16:10:46,761 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000005_0  was -1
2013-10-31 16:10:46,762 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:47,654 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000005_0' has completed task_20131031160444934_0013_m_000005 successfully.
2013-10-31 16:10:47,656 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0013 has completed successfully.
2013-10-31 16:10:47,656 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0013,submitTime=1383235823977,launchTime=1383235824493,firstMapTaskLaunchTime=1383235831713,firstJobSetupTaskLaunchTime=1383235825698,firstJobCleanupTaskLaunchTime=1383235841645,finishTime=1383235847656,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[AB177B931712472A8AB9B4D226E53A7C/AF81984FA2F142A0B8BE2298DF2AFB05] lower*upper/(1/1) ...dpipesplatform/joinhasher
2013-10-31 16:10:47,675 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0. blk_-7665853369446340265_1151
2013-10-31 16:10:47,677 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7665853369446340265_1151 src: /127.0.0.1:54788 dest: /127.0.0.1:41648
2013-10-31 16:10:47,679 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7665853369446340265_1151 src: /127.0.0.1:47786 dest: /127.0.0.1:47311
2013-10-31 16:10:47,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7665853369446340265_1151 src: /127.0.0.1:34685 dest: /127.0.0.1:50942
2013-10-31 16:10:47,690 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34685, dest: /127.0.0.1:50942, bytes: 26349, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7665853369446340265_1151, duration: 5755147
2013-10-31 16:10:47,691 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7665853369446340265_1151 terminating
2013-10-31 16:10:47,691 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47786, dest: /127.0.0.1:47311, bytes: 26349, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7665853369446340265_1151, duration: 4900001
2013-10-31 16:10:47,692 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7665853369446340265_1151 terminating
2013-10-31 16:10:47,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54788, dest: /127.0.0.1:41648, bytes: 26349, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7665853369446340265_1151, duration: 7547819
2013-10-31 16:10:47,693 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7665853369446340265_1151 terminating
2013-10-31 16:10:47,697 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7665853369446340265_1151 size 26349
2013-10-31 16:10:47,699 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0 from client DFSClient_710295022
2013-10-31 16:10:47,700 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0 is closed by DFSClient_710295022
2013-10-31 16:10:47,700 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7665853369446340265_1151 size 26349
2013-10-31 16:10:47,700 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7665853369446340265_1151 size 26349
2013-10-31 16:10:47,709 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:10:47,709 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000004_0'
2013-10-31 16:10:47,710 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000005_0'
2013-10-31 16:10:47,712 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6351416155261990527 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:47,712 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6351416155261990527 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:47,712 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0013
2013-10-31 16:10:47,712 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0013 being deleted.
2013-10-31 16:10:47,712 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6351416155261990527 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:47,715 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0013_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:10:47,719 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary
2013-10-31 16:10:47,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013	dst=null	perm=null
2013-10-31 16:10:47,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2013-10-31 16:10:47,777 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:10:47,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2013-10-31 16:10:47,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2013-10-31 16:10:47,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2013-10-31 16:10:47,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2013-10-31 16:10:47,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2013-10-31 16:10:47,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2013-10-31 16:10:47,787 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34756, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8480038614496047175_1149, duration: 280883
2013-10-31 16:10:47,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2013-10-31 16:10:47,790 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54793, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8296089989830320846_1146, duration: 267484
2013-10-31 16:10:47,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2013-10-31 16:10:47,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47791, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5790387209777498875_1149, duration: 257272
2013-10-31 16:10:47,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2013-10-31 16:10:47,796 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54795, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4333307790222333982_1149, duration: 254656
2013-10-31 16:10:47,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2013-10-31 16:10:47,799 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54796, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3746207844407953251_1150, duration: 255471
2013-10-31 16:10:47,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2013-10-31 16:10:47,816 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:10:47,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2013-10-31 16:10:47,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2013-10-31 16:10:47,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2013-10-31 16:10:47,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2013-10-31 16:10:47,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2013-10-31 16:10:47,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2013-10-31 16:10:47,824 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47794, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8480038614496047175_1149, duration: 132314
2013-10-31 16:10:47,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2013-10-31 16:10:47,826 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34762, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8296089989830320846_1146, duration: 269391
2013-10-31 16:10:47,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2013-10-31 16:10:47,828 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54799, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5790387209777498875_1149, duration: 262408
2013-10-31 16:10:47,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2013-10-31 16:10:47,831 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34695, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4333307790222333982_1149, duration: 294700
2013-10-31 16:10:47,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2013-10-31 16:10:47,833 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54801, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3746207844407953251_1150, duration: 261105
2013-10-31 16:10:47,833 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinhasher
2013-10-31 16:10:47,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2013-10-31 16:10:47,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2013-10-31 16:10:47,840 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54802, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8480038614496047175_1149, duration: 256935
2013-10-31 16:10:47,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2013-10-31 16:10:47,844 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34698, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8296089989830320846_1146, duration: 253547
2013-10-31 16:10:47,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2013-10-31 16:10:47,849 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54804, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5790387209777498875_1149, duration: 269599
2013-10-31 16:10:47,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2013-10-31 16:10:47,854 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34700, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4333307790222333982_1149, duration: 273098
2013-10-31 16:10:47,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2013-10-31 16:10:47,858 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34701, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3746207844407953251_1150, duration: 262836
2013-10-31 16:10:47,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:47,872 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt. blk_-5586763943079904199_1152
2013-10-31 16:10:47,874 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5586763943079904199_1152 src: /127.0.0.1:47804 dest: /127.0.0.1:47311
2013-10-31 16:10:47,875 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5586763943079904199_1152 src: /127.0.0.1:34772 dest: /127.0.0.1:38271
2013-10-31 16:10:47,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5586763943079904199_1152 src: /127.0.0.1:34704 dest: /127.0.0.1:50942
2013-10-31 16:10:47,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34704, dest: /127.0.0.1:50942, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5586763943079904199_1152, duration: 650806
2013-10-31 16:10:47,878 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5586763943079904199_1152 terminating
2013-10-31 16:10:47,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34772, dest: /127.0.0.1:38271, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5586763943079904199_1152, duration: 1007285
2013-10-31 16:10:47,879 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5586763943079904199_1152 terminating
2013-10-31 16:10:47,879 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47804, dest: /127.0.0.1:47311, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5586763943079904199_1152, duration: 1042254
2013-10-31 16:10:47,879 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5586763943079904199_1152 terminating
2013-10-31 16:10:47,880 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5586763943079904199_1152 size 30
2013-10-31 16:10:47,880 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt from client DFSClient_1457307213
2013-10-31 16:10:47,881 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt is closed by DFSClient_1457307213
2013-10-31 16:10:47,881 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5586763943079904199_1152 size 30
2013-10-31 16:10:47,882 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5586763943079904199_1152 size 30
2013-10-31 16:10:47,894 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:10:47,895 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:10:47,915 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] starting
2013-10-31 16:10:47,916 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:10:47,916 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt"]
2013-10-31 16:10:47,916 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:10:47,917 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin"]
2013-10-31 16:10:47,917 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined]  parallel execution is enabled: true
2013-10-31 16:10:47,917 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined]  starting jobs: 2
2013-10-31 16:10:47,917 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined]  allocating threads: 2
2013-10-31 16:10:47,919 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper*joined] starting step: (2/2)
2013-10-31 16:10:47,922 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:10:47,922 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:10:47,946 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-608843021333253453_1140 file build/test/data/dfs/data/data7/current/blk_-608843021333253453 for deletion
2013-10-31 16:10:47,946 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1041963905236869909_1142 file build/test/data/dfs/data/data7/current/blk_1041963905236869909 for deletion
2013-10-31 16:10:47,946 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-608843021333253453_1140 at file build/test/data/dfs/data/data7/current/blk_-608843021333253453
2013-10-31 16:10:47,946 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2084801281739929944_1139 file build/test/data/dfs/data/data7/current/blk_2084801281739929944 for deletion
2013-10-31 16:10:47,947 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1041963905236869909_1142 at file build/test/data/dfs/data/data7/current/blk_1041963905236869909
2013-10-31 16:10:47,947 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3386068009123988079_1141 file build/test/data/dfs/data/data8/current/blk_3386068009123988079 for deletion
2013-10-31 16:10:47,947 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2084801281739929944_1139 at file build/test/data/dfs/data/data7/current/blk_2084801281739929944
2013-10-31 16:10:47,947 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3386068009123988079_1141 at file build/test/data/dfs/data/data8/current/blk_3386068009123988079
2013-10-31 16:10:48,224 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_2084801281739929944_1139 blk_-608843021333253453_1140 blk_-6351416155261990527_1145 blk_1041963905236869909_1142 blk_3386068009123988079_1141
2013-10-31 16:10:48,224 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_2084801281739929944_1139 blk_-608843021333253453_1140 blk_-6351416155261990527_1145 blk_3386068009123988079_1141
2013-10-31 16:10:48,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:48,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:10:48,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,320 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar. blk_3145602704174950073_1153
2013-10-31 16:10:48,322 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3145602704174950073_1153 src: /127.0.0.1:34774 dest: /127.0.0.1:38271
2013-10-31 16:10:48,323 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3145602704174950073_1153 src: /127.0.0.1:54811 dest: /127.0.0.1:41648
2013-10-31 16:10:48,325 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3145602704174950073_1153 src: /127.0.0.1:47809 dest: /127.0.0.1:47311
2013-10-31 16:10:48,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47809, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3145602704174950073_1153, duration: 7874231
2013-10-31 16:10:48,337 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3145602704174950073_1153 terminating
2013-10-31 16:10:48,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54811, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3145602704174950073_1153, duration: 8606367
2013-10-31 16:10:48,338 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3145602704174950073_1153 terminating
2013-10-31 16:10:48,338 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3145602704174950073_1153 size 238055
2013-10-31 16:10:48,338 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34774, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3145602704174950073_1153, duration: 9580497
2013-10-31 16:10:48,339 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3145602704174950073_1153 terminating
2013-10-31 16:10:48,342 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3145602704174950073_1153 size 238055
2013-10-31 16:10:48,342 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar from client DFSClient_1457307213
2013-10-31 16:10:48,343 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar is closed by DFSClient_1457307213
2013-10-31 16:10:48,343 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3145602704174950073_1153 size 238055
2013-10-31 16:10:48,344 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6351416155261990527_1145 file build/test/data/dfs/data/data3/current/blk_-6351416155261990527 for deletion
2013-10-31 16:10:48,345 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-608843021333253453_1140 file build/test/data/dfs/data/data3/current/blk_-608843021333253453 for deletion
2013-10-31 16:10:48,345 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6351416155261990527_1145 at file build/test/data/dfs/data/data3/current/blk_-6351416155261990527
2013-10-31 16:10:48,345 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1041963905236869909_1142 file build/test/data/dfs/data/data3/current/blk_1041963905236869909 for deletion
2013-10-31 16:10:48,345 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-608843021333253453_1140 at file build/test/data/dfs/data/data3/current/blk_-608843021333253453
2013-10-31 16:10:48,346 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2084801281739929944_1139 file build/test/data/dfs/data/data4/current/blk_2084801281739929944 for deletion
2013-10-31 16:10:48,346 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1041963905236869909_1142 at file build/test/data/dfs/data/data3/current/blk_1041963905236869909
2013-10-31 16:10:48,346 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3386068009123988079_1141 file build/test/data/dfs/data/data4/current/blk_3386068009123988079 for deletion
2013-10-31 16:10:48,346 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2084801281739929944_1139 at file build/test/data/dfs/data/data4/current/blk_2084801281739929944
2013-10-31 16:10:48,347 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3386068009123988079_1141 at file build/test/data/dfs/data/data4/current/blk_3386068009123988079
2013-10-31 16:10:48,349 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar. New replication is 10
2013-10-31 16:10:48,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar	dst=null	perm=null
2013-10-31 16:10:48,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,369 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:10:48,373 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:10:48,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:48,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,390 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split. New replication is 10
2013-10-31 16:10:48,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split	dst=null	perm=null
2013-10-31 16:10:48,398 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split. blk_362137174242859386_1154
2013-10-31 16:10:48,400 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_362137174242859386_1154 src: /127.0.0.1:34708 dest: /127.0.0.1:50942
2013-10-31 16:10:48,401 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_362137174242859386_1154 src: /127.0.0.1:47811 dest: /127.0.0.1:47311
2013-10-31 16:10:48,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_362137174242859386_1154 src: /127.0.0.1:34779 dest: /127.0.0.1:38271
2013-10-31 16:10:48,405 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_362137174242859386_1154 src: /127.0.0.1:54816 dest: /127.0.0.1:41648
2013-10-31 16:10:48,408 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54816, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_362137174242859386_1154, duration: 86598
2013-10-31 16:10:48,408 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_362137174242859386_1154 terminating
2013-10-31 16:10:48,409 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34779, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_362137174242859386_1154, duration: 856869
2013-10-31 16:10:48,409 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_362137174242859386_1154 terminating
2013-10-31 16:10:48,410 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47811, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_362137174242859386_1154, duration: 1834822
2013-10-31 16:10:48,410 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_362137174242859386_1154 size 1732
2013-10-31 16:10:48,410 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_362137174242859386_1154 terminating
2013-10-31 16:10:48,411 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34708, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_362137174242859386_1154, duration: 2905762
2013-10-31 16:10:48,411 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_362137174242859386_1154 size 1732
2013-10-31 16:10:48,411 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_362137174242859386_1154 terminating
2013-10-31 16:10:48,413 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_362137174242859386_1154 size 1732
2013-10-31 16:10:48,413 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split from client DFSClient_1457307213
2013-10-31 16:10:48,414 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split is closed by DFSClient_1457307213
2013-10-31 16:10:48,415 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_362137174242859386_1154 size 1732
2013-10-31 16:10:48,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,436 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo. blk_-7737511616191737526_1155
2013-10-31 16:10:48,437 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7737511616191737526_1155 src: /127.0.0.1:54817 dest: /127.0.0.1:41648
2013-10-31 16:10:48,439 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7737511616191737526_1155 src: /127.0.0.1:34713 dest: /127.0.0.1:50942
2013-10-31 16:10:48,441 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7737511616191737526_1155 src: /127.0.0.1:34783 dest: /127.0.0.1:38271
2013-10-31 16:10:48,444 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34783, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7737511616191737526_1155, duration: 59409
2013-10-31 16:10:48,444 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7737511616191737526_1155 terminating
2013-10-31 16:10:48,445 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34713, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7737511616191737526_1155, duration: 775350
2013-10-31 16:10:48,445 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7737511616191737526_1155 terminating
2013-10-31 16:10:48,445 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54817, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7737511616191737526_1155, duration: 1556588
2013-10-31 16:10:48,445 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7737511616191737526_1155 size 183
2013-10-31 16:10:48,446 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7737511616191737526_1155 terminating
2013-10-31 16:10:48,449 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:10:48,450 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:10:48,450 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7737511616191737526_1155 size 183
2013-10-31 16:10:48,451 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7737511616191737526_1155 size 183
2013-10-31 16:10:48,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,475 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml. blk_7152624195160131338_1156
2013-10-31 16:10:48,476 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7152624195160131338_1156 src: /127.0.0.1:34784 dest: /127.0.0.1:38271
2013-10-31 16:10:48,478 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7152624195160131338_1156 src: /127.0.0.1:34716 dest: /127.0.0.1:50942
2013-10-31 16:10:48,480 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7152624195160131338_1156 src: /127.0.0.1:47819 dest: /127.0.0.1:47311
2013-10-31 16:10:48,483 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47819, dest: /127.0.0.1:47311, bytes: 28811, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7152624195160131338_1156, duration: 226572
2013-10-31 16:10:48,483 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7152624195160131338_1156 terminating
2013-10-31 16:10:48,483 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34716, dest: /127.0.0.1:50942, bytes: 28811, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7152624195160131338_1156, duration: 1101591
2013-10-31 16:10:48,484 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7152624195160131338_1156 terminating
2013-10-31 16:10:48,484 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34784, dest: /127.0.0.1:38271, bytes: 28811, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7152624195160131338_1156, duration: 1951015
2013-10-31 16:10:48,485 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7152624195160131338_1156 terminating
2013-10-31 16:10:48,487 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7152624195160131338_1156 size 28811
2013-10-31 16:10:48,487 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml from client DFSClient_1457307213
2013-10-31 16:10:48,487 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml is closed by DFSClient_1457307213
2013-10-31 16:10:48,488 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7152624195160131338_1156 size 28811
2013-10-31 16:10:48,488 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7152624195160131338_1156 size 28811
2013-10-31 16:10:48,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml	dst=null	perm=null
2013-10-31 16:10:48,503 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34719, bytes: 29039, op: HDFS_READ, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7152624195160131338_1156, duration: 402421
2013-10-31 16:10:48,522 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0014: nMaps=5 nReduces=1 max=-1
2013-10-31 16:10:48,523 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0014 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:10:48,523 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0014
2013-10-31 16:10:48,523 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0014	RESULT=SUCCESS
2013-10-31 16:10:48,523 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0014
2013-10-31 16:10:48,525 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper*joined] submitted hadoop job: job_20131031160444934_0014
2013-10-31 16:10:48,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,557 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_conf.xml. blk_-8751337026572452485_1158
2013-10-31 16:10:48,559 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8751337026572452485_1158 src: /127.0.0.1:34720 dest: /127.0.0.1:50942
2013-10-31 16:10:48,560 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8751337026572452485_1158 src: /127.0.0.1:47823 dest: /127.0.0.1:47311
2013-10-31 16:10:48,562 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8751337026572452485_1158 src: /127.0.0.1:54827 dest: /127.0.0.1:41648
2013-10-31 16:10:48,583 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54827, dest: /127.0.0.1:41648, bytes: 28876, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8751337026572452485_1158, duration: 92458
2013-10-31 16:10:48,583 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8751337026572452485_1158 terminating
2013-10-31 16:10:48,587 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47823, dest: /127.0.0.1:47311, bytes: 28876, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8751337026572452485_1158, duration: 1861906
2013-10-31 16:10:48,590 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8751337026572452485_1158 terminating
2013-10-31 16:10:48,590 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8751337026572452485_1158 size 28876
2013-10-31 16:10:48,590 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34720, dest: /127.0.0.1:50942, bytes: 28876, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8751337026572452485_1158, duration: 7760462
2013-10-31 16:10:48,592 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8751337026572452485_1158 terminating
2013-10-31 16:10:48,594 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8751337026572452485_1158 size 28876
2013-10-31 16:10:48,596 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_conf.xml from client DFSClient_1152728397
2013-10-31 16:10:48,596 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_conf.xml is closed by DFSClient_1152728397
2013-10-31 16:10:48,597 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8751337026572452485_1158 size 28876
2013-10-31 16:10:49,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:49,097 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken. blk_7144251647658547015_1159
2013-10-31 16:10:49,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7144251647658547015_1159 src: /127.0.0.1:34723 dest: /127.0.0.1:50942
2013-10-31 16:10:49,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7144251647658547015_1159 src: /127.0.0.1:34793 dest: /127.0.0.1:38271
2013-10-31 16:10:49,103 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7144251647658547015_1159 src: /127.0.0.1:54830 dest: /127.0.0.1:41648
2013-10-31 16:10:49,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54830, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7144251647658547015_1159, duration: 65574
2013-10-31 16:10:49,106 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7144251647658547015_1159 terminating
2013-10-31 16:10:49,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34793, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7144251647658547015_1159, duration: 838380
2013-10-31 16:10:49,107 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7144251647658547015_1159 terminating
2013-10-31 16:10:49,107 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7144251647658547015_1159 size 116
2013-10-31 16:10:49,107 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34723, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7144251647658547015_1159, duration: 1784166
2013-10-31 16:10:49,108 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7144251647658547015_1159 size 116
2013-10-31 16:10:49,108 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7144251647658547015_1159 terminating
2013-10-31 16:10:49,110 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken from client DFSClient_1457307213
2013-10-31 16:10:49,111 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken is closed by DFSClient_1457307213
2013-10-31 16:10:49,112 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7144251647658547015_1159 size 116
2013-10-31 16:10:49,117 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken
2013-10-31 16:10:49,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:10:49,121 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54831, bytes: 187, op: HDFS_READ, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7737511616191737526_1155, duration: 276415
2013-10-31 16:10:49,122 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0014 = 19. Number of splits = 5
2013-10-31 16:10:49,122 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,123 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,123 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,123 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,123 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,124 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,124 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,124 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,124 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,126 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,126 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0014 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:10:49,127 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0014 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:10:49,739 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0014_m_000006_0' to tip task_20131031160444934_0014_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:49,743 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000000_0'
2013-10-31 16:10:49,744 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000001_0'
2013-10-31 16:10:49,744 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000006_0'
2013-10-31 16:10:49,745 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:10:49,746 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000006_0 which needs 1 slots
2013-10-31 16:10:49,746 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000006_0 which needs 1 slots
2013-10-31 16:10:49,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken	dst=null	perm=null
2013-10-31 16:10:49,754 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34796, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7144251647658547015_1159, duration: 281591
2013-10-31 16:10:49,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml	dst=null	perm=null
2013-10-31 16:10:49,764 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34729, bytes: 29039, op: HDFS_READ, cliID: DFSClient_-1506749740, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7152624195160131338_1156, duration: 381902
2013-10-31 16:10:49,795 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:49,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar	dst=null	perm=null
2013-10-31 16:10:49,826 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47832, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1506749740, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3145602704174950073_1153, duration: 1419539
2013-10-31 16:10:49,923 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0013_m_-954554037
2013-10-31 16:10:49,930 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17387 with signal TERM. Exit code 0
2013-10-31 16:10:49,930 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-1305407431
2013-10-31 16:10:49,931 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-1305407431 spawned.
2013-10-31 16:10:49,932 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000006_0/taskjvm.sh
2013-10-31 16:10:50,009 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000002_0'
2013-10-31 16:10:50,009 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000003_0'
2013-10-31 16:10:50,156 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:50,156 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:50,156 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:50,156 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_-954554037 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:10:50,744 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6351416155261990527_1145 file build/test/data/dfs/data/data2/current/blk_-6351416155261990527 for deletion
2013-10-31 16:10:50,745 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-608843021333253453_1140 file build/test/data/dfs/data/data2/current/blk_-608843021333253453 for deletion
2013-10-31 16:10:50,745 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6351416155261990527_1145 at file build/test/data/dfs/data/data2/current/blk_-6351416155261990527
2013-10-31 16:10:50,745 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2084801281739929944_1139 file build/test/data/dfs/data/data1/current/blk_2084801281739929944 for deletion
2013-10-31 16:10:50,745 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-608843021333253453_1140 at file build/test/data/dfs/data/data2/current/blk_-608843021333253453
2013-10-31 16:10:50,745 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3386068009123988079_1141 file build/test/data/dfs/data/data1/current/blk_3386068009123988079 for deletion
2013-10-31 16:10:50,745 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2084801281739929944_1139 at file build/test/data/dfs/data/data1/current/blk_2084801281739929944
2013-10-31 16:10:50,745 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3386068009123988079_1141 at file build/test/data/dfs/data/data1/current/blk_3386068009123988079
2013-10-31 16:10:50,938 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1305407431 given task: attempt_20131031160444934_0014_m_000006_0
2013-10-31 16:10:51,225 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_3145602704174950073_1153 to datanode(s) 127.0.0.1:50942
2013-10-31 16:10:51,225 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-6351416155261990527_1145
2013-10-31 16:10:51,441 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 847 Total time for transactions(ms): 16Number of transactions batched in Syncs: 80 Number of syncs: 600 SyncTimes(ms): 25189 3180 
2013-10-31 16:10:51,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:52,712 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0013
2013-10-31 16:10:52,712 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000004_0 not found in cache
2013-10-31 16:10:52,712 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000005_0 not found in cache
2013-10-31 16:10:52,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0013 for user-log deletion with retainTimeStamp:1383322252713
2013-10-31 16:10:52,798 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0013_m_-28830232 since job job_20131031160444934_0013 is dead
2013-10-31 16:10:52,809 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17693 with signal TERM. Exit code 0
2013-10-31 16:10:52,975 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:52,975 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:52,976 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:52,976 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_-28830232 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:53,333 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0013_m_1197284086 since job job_20131031160444934_0013 is dead
2013-10-31 16:10:53,345 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17878 with signal TERM. Exit code 0
2013-10-31 16:10:53,515 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:53,516 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:53,516 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:53,516 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_1197284086 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:53,746 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_3145602704174950073_1153 to 127.0.0.1:50942 
2013-10-31 16:10:53,748 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3145602704174950073_1153 src: /127.0.0.1:34733 dest: /127.0.0.1:50942
2013-10-31 16:10:53,748 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_3145602704174950073_1153 to /127.0.0.1:50942
2013-10-31 16:10:53,751 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3145602704174950073_1153 src: /127.0.0.1:34733 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:10:53,754 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3145602704174950073_1153 size 238055
2013-10-31 16:10:53,948 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6351416155261990527_1145 file build/test/data/dfs/data/data8/current/blk_-6351416155261990527 for deletion
2013-10-31 16:10:53,948 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6351416155261990527_1145 at file build/test/data/dfs/data/data8/current/blk_-6351416155261990527
2013-10-31 16:10:54,375 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000006_0 0.0% setup
2013-10-31 16:10:54,378 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000006_0 is done.
2013-10-31 16:10:54,378 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000006_0  was -1
2013-10-31 16:10:54,379 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:54,746 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0013
2013-10-31 16:10:54,746 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000000_0 not found in cache
2013-10-31 16:10:54,746 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000001_0 not found in cache
2013-10-31 16:10:54,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0013 for user-log deletion with retainTimeStamp:1383322254747
2013-10-31 16:10:55,010 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0013
2013-10-31 16:10:55,011 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000002_0 not found in cache
2013-10-31 16:10:55,011 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000003_0 not found in cache
2013-10-31 16:10:55,012 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0013 for user-log deletion with retainTimeStamp:1383322255011
2013-10-31 16:10:55,137 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0013_m_299302560 since job job_20131031160444934_0013 is dead
2013-10-31 16:10:55,146 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17594 with signal TERM. Exit code 0
2013-10-31 16:10:55,206 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0013_m_-544706238 since job job_20131031160444934_0013 is dead
2013-10-31 16:10:55,210 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17629 with signal TERM. Exit code 0
2013-10-31 16:10:55,315 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:55,316 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:55,316 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:55,317 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_299302560 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:55,375 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:55,376 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:55,376 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:55,376 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_-544706238 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:55,752 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000006_0' has completed task_20131031160444934_0014_m_000006 successfully.
2013-10-31 16:10:55,761 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000000_0' to tip task_20131031160444934_0014_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:55,762 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000000
2013-10-31 16:10:55,762 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000001_0' to tip task_20131031160444934_0014_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:55,763 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000001
2013-10-31 16:10:55,765 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:10:55,766 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:10:55,766 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000000_0 which needs 1 slots
2013-10-31 16:10:55,766 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000000_0 which needs 1 slots
2013-10-31 16:10:55,766 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000001_0 which needs 1 slots
2013-10-31 16:10:55,767 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0014_m_000001_0 which needs 1 slots
2013-10-31 16:10:55,803 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0014/attempt_20131031160444934_0014_m_000000_0. Attempting to reuse: jvm_20131031160444934_0014_m_-1305407431
2013-10-31 16:10:55,803 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0013_m_1014058939
2013-10-31 16:10:55,807 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17531 with signal TERM. Exit code 0
2013-10-31 16:10:55,807 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-291033684
2013-10-31 16:10:55,808 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-291033684 spawned.
2013-10-31 16:10:55,809 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000001_0/taskjvm.sh
2013-10-31 16:10:55,917 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:55,918 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:55,918 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:10:55,918 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_1014058939 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:55,938 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1305407431 given task: attempt_20131031160444934_0014_m_000000_0
2013-10-31 16:10:56,015 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000002_0' to tip task_20131031160444934_0014_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:10:56,016 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000002
2013-10-31 16:10:56,016 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000003_0' to tip task_20131031160444934_0014_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:10:56,016 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000003
2013-10-31 16:10:56,017 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:10:56,017 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:10:56,018 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000002_0 which needs 1 slots
2013-10-31 16:10:56,018 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000002_0 which needs 1 slots
2013-10-31 16:10:56,018 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000003_0 which needs 1 slots
2013-10-31 16:10:56,018 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0014_m_000003_0 which needs 1 slots
2013-10-31 16:10:56,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken	dst=null	perm=null
2013-10-31 16:10:56,022 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34805, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7144251647658547015_1159, duration: 135836
2013-10-31 16:10:56,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml	dst=null	perm=null
2013-10-31 16:10:56,026 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34738, bytes: 29039, op: HDFS_READ, cliID: DFSClient_1552433242, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7152624195160131338_1156, duration: 216561
2013-10-31 16:10:56,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split	dst=null	perm=null
2013-10-31 16:10:56,040 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:56,041 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34739, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_362137174242859386_1154, duration: 151892
2013-10-31 16:10:56,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar	dst=null	perm=null
2013-10-31 16:10:56,054 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34740, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1552433242, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3145602704174950073_1153, duration: 630180
2013-10-31 16:10:56,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:56,123 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-766613114
2013-10-31 16:10:56,124 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-766613114 spawned.
2013-10-31 16:10:56,124 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-1082003416
2013-10-31 16:10:56,124 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-1082003416 spawned.
2013-10-31 16:10:56,125 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000002_0/taskjvm.sh
2013-10-31 16:10:56,125 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000003_0/taskjvm.sh
2013-10-31 16:10:56,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:56,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:56,449 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47843, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 130986
2013-10-31 16:10:56,452 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34742, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 103919
2013-10-31 16:10:56,677 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-291033684 given task: attempt_20131031160444934_0014_m_000001_0
2013-10-31 16:10:56,717 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000004_0' to tip task_20131031160444934_0014_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:10:56,718 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000004
2013-10-31 16:10:56,719 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:10:56,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000004_0 which needs 1 slots
2013-10-31 16:10:56,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000004_0 which needs 1 slots
2013-10-31 16:10:56,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken	dst=null	perm=null
2013-10-31 16:10:56,724 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34813, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7144251647658547015_1159, duration: 137221
2013-10-31 16:10:56,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml	dst=null	perm=null
2013-10-31 16:10:56,729 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34815, bytes: 29039, op: HDFS_READ, cliID: DFSClient_929937689, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7152624195160131338_1156, duration: 180938
2013-10-31 16:10:56,742 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:56,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar	dst=null	perm=null
2013-10-31 16:10:56,757 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34816, bytes: 239915, op: HDFS_READ, cliID: DFSClient_929937689, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3145602704174950073_1153, duration: 663942
2013-10-31 16:10:56,811 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-1646548683
2013-10-31 16:10:56,812 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-1646548683 spawned.
2013-10-31 16:10:56,813 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000004_0/taskjvm.sh
2013-10-31 16:10:57,023 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-766613114 given task: attempt_20131031160444934_0014_m_000002_0
2013-10-31 16:10:57,030 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1082003416 given task: attempt_20131031160444934_0014_m_000003_0
2013-10-31 16:10:57,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split	dst=null	perm=null
2013-10-31 16:10:57,227 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34820, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_362137174242859386_1154, duration: 213805
2013-10-31 16:10:57,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:57,266 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34752, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 126454
2013-10-31 16:10:57,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:57,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:57,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split	dst=null	perm=null
2013-10-31 16:10:57,544 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54861, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 138833
2013-10-31 16:10:57,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split	dst=null	perm=null
2013-10-31 16:10:57,549 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54862, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_362137174242859386_1154, duration: 169405
2013-10-31 16:10:57,550 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34758, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_362137174242859386_1154, duration: 146579
2013-10-31 16:10:57,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:57,588 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34759, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 122725
2013-10-31 16:10:57,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:57,590 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34829, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 106900
2013-10-31 16:10:57,762 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1646548683 given task: attempt_20131031160444934_0014_m_000004_0
2013-10-31 16:10:57,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:57,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:57,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:57,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:57,875 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34762, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 131350
2013-10-31 16:10:57,876 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54868, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 136171
2013-10-31 16:10:58,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split	dst=null	perm=null
2013-10-31 16:10:58,263 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34834, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_362137174242859386_1154, duration: 413543
2013-10-31 16:10:58,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:10:58,303 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34835, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 313234
2013-10-31 16:10:58,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:58,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:10:58,601 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47869, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 132867
2013-10-31 16:10:59,006 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:10:59,008 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000000_0 is done.
2013-10-31 16:10:59,009 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000000_0  was 35
2013-10-31 16:10:59,009 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:11:00,156 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:11:00,158 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000001_0 is done.
2013-10-31 16:11:00,159 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000001_0  was 35
2013-10-31 16:11:00,159 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:00,462 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:11:00,464 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000003_0 is done.
2013-10-31 16:11:00,464 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000003_0  was 35
2013-10-31 16:11:00,464 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:11:00,464 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:11:00,466 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000002_0 is done.
2013-10-31 16:11:00,466 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000002_0  was 35
2013-10-31 16:11:00,466 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:00,766 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0014_m_000006_0
2013-10-31 16:11:00,766 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0014_m_000006_0
2013-10-31 16:11:00,767 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0014_m_000006_0 not found in cache
2013-10-31 16:11:01,182 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:11:01,185 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000004_0 is done.
2013-10-31 16:11:01,185 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000004_0  was 35
2013-10-31 16:11:01,186 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:01,772 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000000_0' has completed task_20131031160444934_0014_m_000000 successfully.
2013-10-31 16:11:01,773 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000001_0' has completed task_20131031160444934_0014_m_000001 successfully.
2013-10-31 16:11:01,774 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0014_r_000000_0' to tip task_20131031160444934_0014_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:11:01,776 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:11:01,777 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_r_000000_0 which needs 1 slots
2013-10-31 16:11:01,777 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_r_000000_0 which needs 1 slots
2013-10-31 16:11:01,797 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_r_-1113874899
2013-10-31 16:11:01,798 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_r_-1113874899 spawned.
2013-10-31 16:11:01,801 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_r_000000_0/taskjvm.sh
2013-10-31 16:11:01,836 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-3451961400852813586_1083
2013-10-31 16:11:02,024 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000002_0' has completed task_20131031160444934_0014_m_000002 successfully.
2013-10-31 16:11:02,763 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000003_0' has completed task_20131031160444934_0014_m_000003 successfully.
2013-10-31 16:11:02,764 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000004_0' has completed task_20131031160444934_0014_m_000004 successfully.
2013-10-31 16:11:03,537 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_r_-1113874899 given task: attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:09,227 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46564, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000000_0, duration: 9467744
2013-10-31 16:11:09,244 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46564, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000001_0, duration: 9945651
2013-10-31 16:11:09,261 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58497, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000002_0, duration: 12154305
2013-10-31 16:11:09,276 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58497, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000003_0, duration: 11459409
2013-10-31 16:11:09,293 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42700, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000004_0, duration: 12626467
2013-10-31 16:11:10,045 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:11:10,089 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:11:10,148 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:11:10,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:10,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:10,390 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000. blk_-8992668016065045310_1160
2013-10-31 16:11:10,431 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8992668016065045310_1160 src: /127.0.0.1:54879 dest: /127.0.0.1:41648
2013-10-31 16:11:10,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8992668016065045310_1160 src: /127.0.0.1:47877 dest: /127.0.0.1:47311
2013-10-31 16:11:10,434 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8992668016065045310_1160 src: /127.0.0.1:34845 dest: /127.0.0.1:38271
2013-10-31 16:11:10,436 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34845, dest: /127.0.0.1:38271, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0014_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8992668016065045310_1160, duration: 1323698
2013-10-31 16:11:10,436 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8992668016065045310_1160 terminating
2013-10-31 16:11:10,436 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47877, dest: /127.0.0.1:47311, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0014_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8992668016065045310_1160, duration: 1265717
2013-10-31 16:11:10,436 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8992668016065045310_1160 terminating
2013-10-31 16:11:10,437 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54879, dest: /127.0.0.1:41648, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0014_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8992668016065045310_1160, duration: 1790655
2013-10-31 16:11:10,437 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8992668016065045310_1160 terminating
2013-10-31 16:11:10,439 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8992668016065045310_1160 size 240
2013-10-31 16:11:10,440 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:10,440 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:10,440 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8992668016065045310_1160 size 240
2013-10-31 16:11:10,441 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8992668016065045310_1160 size 240
2013-10-31 16:11:10,477 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0014_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:10,477 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:11:10,786 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031160444934_0014_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:11:10,787 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:11,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0	dst=null	perm=null
2013-10-31 16:11:11,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:12,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:12,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0	dst=null	perm=null
2013-10-31 16:11:13,095 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 1.0% reduce > reduce
2013-10-31 16:11:13,097 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 1.0% reduce > reduce
2013-10-31 16:11:13,098 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_r_000000_0 is done.
2013-10-31 16:11:13,098 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_r_000000_0  was -1
2013-10-31 16:11:13,098 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:13,791 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_r_000000_0' has completed task_20131031160444934_0014_r_000000 successfully.
2013-10-31 16:11:13,874 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0014_m_000005_0' to tip task_20131031160444934_0014_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:11:13,877 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:11:13,877 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000005_0 which needs 1 slots
2013-10-31 16:11:13,877 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000005_0 which needs 1 slots
2013-10-31 16:11:14,051 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0014/attempt_20131031160444934_0014_m_000005_0. Attempting to reuse: jvm_20131031160444934_0014_m_-1305407431
2013-10-31 16:11:14,555 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1305407431 given task: attempt_20131031160444934_0014_m_000005_0
2013-10-31 16:11:14,660 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000005_0 0.0% 
2013-10-31 16:11:14,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary	dst=null	perm=null
2013-10-31 16:11:14,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:14,678 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_SUCCESS from client DFSClient_attempt_20131031160444934_0014_m_000005_0
2013-10-31 16:11:14,678 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0014_m_000005_0
2013-10-31 16:11:14,684 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3145602704174950073 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:14,685 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3145602704174950073 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:14,685 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3145602704174950073 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:14,685 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3145602704174950073 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:14,685 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_362137174242859386 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:14,685 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_362137174242859386 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:14,685 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_362137174242859386 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:14,685 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_362137174242859386 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:14,686 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7737511616191737526 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:14,686 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7737511616191737526 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:14,686 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7737511616191737526 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:14,686 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7152624195160131338 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:14,686 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7152624195160131338 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:14,686 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7152624195160131338 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:14,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014	dst=null	perm=null
2013-10-31 16:11:15,229 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_7152624195160131338_1156 blk_3145602704174950073_1153 blk_362137174242859386_1154 blk_-7737511616191737526_1155
2013-10-31 16:11:15,229 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_7152624195160131338_1156 blk_3145602704174950073_1153 blk_362137174242859386_1154 blk_-7737511616191737526_1155
2013-10-31 16:11:17,634 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000005_0 0.0% cleanup
2013-10-31 16:11:17,636 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000005_0 is done.
2013-10-31 16:11:17,636 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000005_0  was -1
2013-10-31 16:11:17,636 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:17,754 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7737511616191737526_1155 file build/test/data/dfs/data/data2/current/blk_-7737511616191737526 for deletion
2013-10-31 16:11:17,754 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_362137174242859386_1154 file build/test/data/dfs/data/data1/current/blk_362137174242859386 for deletion
2013-10-31 16:11:17,754 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7737511616191737526_1155 at file build/test/data/dfs/data/data2/current/blk_-7737511616191737526
2013-10-31 16:11:17,754 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3145602704174950073_1153 file build/test/data/dfs/data/data2/current/blk_3145602704174950073 for deletion
2013-10-31 16:11:17,754 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_362137174242859386_1154 at file build/test/data/dfs/data/data1/current/blk_362137174242859386
2013-10-31 16:11:17,755 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7152624195160131338_1156 file build/test/data/dfs/data/data1/current/blk_7152624195160131338 for deletion
2013-10-31 16:11:17,755 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3145602704174950073_1153 at file build/test/data/dfs/data/data2/current/blk_3145602704174950073
2013-10-31 16:11:17,755 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7152624195160131338_1156 at file build/test/data/dfs/data/data1/current/blk_7152624195160131338
2013-10-31 16:11:17,956 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7737511616191737526_1155 file build/test/data/dfs/data/data8/current/blk_-7737511616191737526 for deletion
2013-10-31 16:11:17,956 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_362137174242859386_1154 file build/test/data/dfs/data/data7/current/blk_362137174242859386 for deletion
2013-10-31 16:11:17,956 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7737511616191737526_1155 at file build/test/data/dfs/data/data8/current/blk_-7737511616191737526
2013-10-31 16:11:17,957 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_362137174242859386_1154 at file build/test/data/dfs/data/data7/current/blk_362137174242859386
2013-10-31 16:11:17,957 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3145602704174950073_1153 file build/test/data/dfs/data/data8/current/blk_3145602704174950073 for deletion
2013-10-31 16:11:17,957 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7152624195160131338_1156 file build/test/data/dfs/data/data7/current/blk_7152624195160131338 for deletion
2013-10-31 16:11:17,958 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3145602704174950073_1153 at file build/test/data/dfs/data/data8/current/blk_3145602704174950073
2013-10-31 16:11:17,958 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7152624195160131338_1156 at file build/test/data/dfs/data/data7/current/blk_7152624195160131338
2013-10-31 16:11:18,230 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_3145602704174950073_1153 blk_362137174242859386_1154 blk_-7737511616191737526_1155
2013-10-31 16:11:18,230 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_7152624195160131338_1156 blk_3145602704174950073_1153 blk_362137174242859386_1154
2013-10-31 16:11:18,354 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_362137174242859386_1154 file build/test/data/dfs/data/data3/current/blk_362137174242859386 for deletion
2013-10-31 16:11:18,355 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3145602704174950073_1153 file build/test/data/dfs/data/data4/current/blk_3145602704174950073 for deletion
2013-10-31 16:11:18,355 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_362137174242859386_1154 at file build/test/data/dfs/data/data3/current/blk_362137174242859386
2013-10-31 16:11:18,355 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7152624195160131338_1156 file build/test/data/dfs/data/data4/current/blk_7152624195160131338 for deletion
2013-10-31 16:11:18,355 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3145602704174950073_1153 at file build/test/data/dfs/data/data4/current/blk_3145602704174950073
2013-10-31 16:11:18,356 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7152624195160131338_1156 at file build/test/data/dfs/data/data4/current/blk_7152624195160131338
2013-10-31 16:11:18,877 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:18,877 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:18,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7737511616191737526_1155 file build/test/data/dfs/data/data6/current/blk_-7737511616191737526 for deletion
2013-10-31 16:11:18,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_362137174242859386_1154 file build/test/data/dfs/data/data5/current/blk_362137174242859386 for deletion
2013-10-31 16:11:18,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7737511616191737526_1155 at file build/test/data/dfs/data/data6/current/blk_-7737511616191737526
2013-10-31 16:11:18,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3145602704174950073_1153 file build/test/data/dfs/data/data6/current/blk_3145602704174950073 for deletion
2013-10-31 16:11:18,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_362137174242859386_1154 at file build/test/data/dfs/data/data5/current/blk_362137174242859386
2013-10-31 16:11:18,968 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3145602704174950073_1153 at file build/test/data/dfs/data/data6/current/blk_3145602704174950073
2013-10-31 16:11:19,884 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000005_0' has completed task_20131031160444934_0014_m_000005 successfully.
2013-10-31 16:11:19,885 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0014 has completed successfully.
2013-10-31 16:11:19,885 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0014,submitTime=1383235848494,launchTime=1383235849126,firstMapTaskLaunchTime=1383235855760,firstReduceTaskLaunchTime=1383235861774,firstJobSetupTaskLaunchTime=1383235849739,firstJobCleanupTaskLaunchTime=1383235873874,finishTime=1383235879885,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=28,reduceSlotsSeconds=11,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[EF9B8E00CB3E43349A0B2FF055BDD740/7920D98E474F40E192B1E8DF84897267] lower*upper*joined/(2/2)
2013-10-31 16:11:19,892 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1. blk_-4576546115426846666_1161
2013-10-31 16:11:19,894 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4576546115426846666_1161 src: /127.0.0.1:47881 dest: /127.0.0.1:47311
2013-10-31 16:11:19,897 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4576546115426846666_1161 src: /127.0.0.1:34781 dest: /127.0.0.1:50942
2013-10-31 16:11:19,899 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4576546115426846666_1161 src: /127.0.0.1:54887 dest: /127.0.0.1:41648
2013-10-31 16:11:19,904 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54887, dest: /127.0.0.1:41648, bytes: 31976, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4576546115426846666_1161, duration: 101651
2013-10-31 16:11:19,905 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4576546115426846666_1161 terminating
2013-10-31 16:11:19,905 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34781, dest: /127.0.0.1:50942, bytes: 31976, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4576546115426846666_1161, duration: 3803760
2013-10-31 16:11:19,906 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4576546115426846666_1161 terminating
2013-10-31 16:11:19,906 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47881, dest: /127.0.0.1:47311, bytes: 31976, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4576546115426846666_1161, duration: 4741960
2013-10-31 16:11:19,907 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4576546115426846666_1161 terminating
2013-10-31 16:11:19,907 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4576546115426846666_1161 size 31976
2013-10-31 16:11:19,910 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1 from client DFSClient_1152728397
2013-10-31 16:11:19,911 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1 is closed by DFSClient_1152728397
2013-10-31 16:11:19,911 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4576546115426846666_1161 size 31976
2013-10-31 16:11:19,911 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4576546115426846666_1161 size 31976
2013-10-31 16:11:19,916 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:11:19,917 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000000_0'
2013-10-31 16:11:19,918 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7144251647658547015 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:19,918 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000001_0'
2013-10-31 16:11:19,918 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7144251647658547015 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:19,918 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000005_0'
2013-10-31 16:11:19,919 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7144251647658547015 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:19,919 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000006_0'
2013-10-31 16:11:19,919 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_r_000000_0'
2013-10-31 16:11:19,922 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0014_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:11:19,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014	dst=null	perm=null
2013-10-31 16:11:19,924 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper*joined] starting step: (1/2) ...splatform/joingroupbyjoin
2013-10-31 16:11:19,930 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:11:19,930 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:11:19,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:19,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:11:19,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:19,949 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar. blk_7182447276496863409_1162
2013-10-31 16:11:19,950 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7182447276496863409_1162 src: /127.0.0.1:34784 dest: /127.0.0.1:50942
2013-10-31 16:11:19,951 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7182447276496863409_1162 src: /127.0.0.1:47887 dest: /127.0.0.1:47311
2013-10-31 16:11:19,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7182447276496863409_1162 src: /127.0.0.1:54891 dest: /127.0.0.1:41648
2013-10-31 16:11:19,961 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54891, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7182447276496863409_1162, duration: 5929978
2013-10-31 16:11:19,961 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7182447276496863409_1162 terminating
2013-10-31 16:11:19,961 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7182447276496863409_1162 size 238055
2013-10-31 16:11:19,962 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47887, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7182447276496863409_1162, duration: 7560530
2013-10-31 16:11:19,962 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7182447276496863409_1162 terminating
2013-10-31 16:11:19,963 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34784, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7182447276496863409_1162, duration: 8051684
2013-10-31 16:11:19,963 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7182447276496863409_1162 terminating
2013-10-31 16:11:19,963 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7182447276496863409_1162 size 238055
2013-10-31 16:11:19,965 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar from client DFSClient_1457307213
2013-10-31 16:11:19,965 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar is closed by DFSClient_1457307213
2013-10-31 16:11:19,966 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7182447276496863409_1162 size 238055
2013-10-31 16:11:19,970 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar. New replication is 10
2013-10-31 16:11:19,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar	dst=null	perm=null
2013-10-31 16:11:20,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,385 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:11:20,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84	dst=null	perm=null
2013-10-31 16:11:20,389 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:11:20,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/part-00000	dst=null	perm=null
2013-10-31 16:11:20,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,407 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split. New replication is 10
2013-10-31 16:11:20,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split	dst=null	perm=null
2013-10-31 16:11:20,417 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split. blk_5457425651477839543_1163
2013-10-31 16:11:20,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5457425651477839543_1163 src: /127.0.0.1:34787 dest: /127.0.0.1:50942
2013-10-31 16:11:20,419 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5457425651477839543_1163 src: /127.0.0.1:47890 dest: /127.0.0.1:47311
2013-10-31 16:11:20,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5457425651477839543_1163 src: /127.0.0.1:34858 dest: /127.0.0.1:38271
2013-10-31 16:11:20,421 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5457425651477839543_1163 src: /127.0.0.1:54895 dest: /127.0.0.1:41648
2013-10-31 16:11:20,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54895, dest: /127.0.0.1:41648, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5457425651477839543_1163, duration: 113902
2013-10-31 16:11:20,424 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5457425651477839543_1163 terminating
2013-10-31 16:11:20,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34858, dest: /127.0.0.1:38271, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5457425651477839543_1163, duration: 466250
2013-10-31 16:11:20,424 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5457425651477839543_1163 terminating
2013-10-31 16:11:20,425 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5457425651477839543_1163 size 358
2013-10-31 16:11:20,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47890, dest: /127.0.0.1:47311, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5457425651477839543_1163, duration: 857923
2013-10-31 16:11:20,425 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5457425651477839543_1163 size 358
2013-10-31 16:11:20,425 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5457425651477839543_1163 terminating
2013-10-31 16:11:20,426 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34787, dest: /127.0.0.1:50942, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5457425651477839543_1163, duration: 1804688
2013-10-31 16:11:20,426 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5457425651477839543_1163 size 358
2013-10-31 16:11:20,427 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_5457425651477839543_1163 terminating
2013-10-31 16:11:20,430 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5457425651477839543_1163 size 358
2013-10-31 16:11:20,430 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split from client DFSClient_1457307213
2013-10-31 16:11:20,430 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split is closed by DFSClient_1457307213
2013-10-31 16:11:20,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,451 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo. blk_-2024600585106326716_1164
2013-10-31 16:11:20,452 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2024600585106326716_1164 src: /127.0.0.1:54896 dest: /127.0.0.1:41648
2013-10-31 16:11:20,454 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2024600585106326716_1164 src: /127.0.0.1:34792 dest: /127.0.0.1:50942
2013-10-31 16:11:20,455 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2024600585106326716_1164 src: /127.0.0.1:34862 dest: /127.0.0.1:38271
2013-10-31 16:11:20,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34862, dest: /127.0.0.1:38271, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2024600585106326716_1164, duration: 70958
2013-10-31 16:11:20,458 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2024600585106326716_1164 terminating
2013-10-31 16:11:20,458 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34792, dest: /127.0.0.1:50942, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2024600585106326716_1164, duration: 905546
2013-10-31 16:11:20,459 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2024600585106326716_1164 terminating
2013-10-31 16:11:20,459 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2024600585106326716_1164 size 44
2013-10-31 16:11:20,459 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54896, dest: /127.0.0.1:41648, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2024600585106326716_1164, duration: 2049344
2013-10-31 16:11:20,460 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2024600585106326716_1164 size 44
2013-10-31 16:11:20,460 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2024600585106326716_1164 terminating
2013-10-31 16:11:20,462 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2024600585106326716_1164 size 44
2013-10-31 16:11:20,462 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:11:20,463 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:11:20,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,494 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml. blk_2522765479875883258_1165
2013-10-31 16:11:20,495 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2522765479875883258_1165 src: /127.0.0.1:47896 dest: /127.0.0.1:47311
2013-10-31 16:11:20,497 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2522765479875883258_1165 src: /127.0.0.1:34795 dest: /127.0.0.1:50942
2013-10-31 16:11:20,498 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2522765479875883258_1165 src: /127.0.0.1:34865 dest: /127.0.0.1:38271
2013-10-31 16:11:20,501 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34865, dest: /127.0.0.1:38271, bytes: 28698, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2522765479875883258_1165, duration: 1384267
2013-10-31 16:11:20,502 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2522765479875883258_1165 terminating
2013-10-31 16:11:20,502 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34795, dest: /127.0.0.1:50942, bytes: 28698, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2522765479875883258_1165, duration: 1337163
2013-10-31 16:11:20,503 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2522765479875883258_1165 terminating
2013-10-31 16:11:20,503 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47896, dest: /127.0.0.1:47311, bytes: 28698, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2522765479875883258_1165, duration: 2429278
2013-10-31 16:11:20,504 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2522765479875883258_1165 terminating
2013-10-31 16:11:20,504 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2522765479875883258_1165 size 28698
2013-10-31 16:11:20,505 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml from client DFSClient_1457307213
2013-10-31 16:11:20,506 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml is closed by DFSClient_1457307213
2013-10-31 16:11:20,506 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2522765479875883258_1165 size 28698
2013-10-31 16:11:20,507 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2522765479875883258_1165 size 28698
2013-10-31 16:11:20,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml	dst=null	perm=null
2013-10-31 16:11:20,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34798, bytes: 28926, op: HDFS_READ, cliID: DFSClient_37059141, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2522765479875883258_1165, duration: 388612
2013-10-31 16:11:20,547 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0015: nMaps=1 nReduces=0 max=-1
2013-10-31 16:11:20,547 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0015 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:11:20,547 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0015
2013-10-31 16:11:20,548 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0015	RESULT=SUCCESS
2013-10-31 16:11:20,548 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0015
2013-10-31 16:11:20,550 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper*joined] submitted hadoop job: job_20131031160444934_0015
2013-10-31 16:11:20,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,585 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_conf.xml. blk_-9178176872107315078_1167
2013-10-31 16:11:20,587 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9178176872107315078_1167 src: /127.0.0.1:34868 dest: /127.0.0.1:38271
2013-10-31 16:11:20,589 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9178176872107315078_1167 src: /127.0.0.1:54905 dest: /127.0.0.1:41648
2013-10-31 16:11:20,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9178176872107315078_1167 src: /127.0.0.1:34801 dest: /127.0.0.1:50942
2013-10-31 16:11:20,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34801, dest: /127.0.0.1:50942, bytes: 28763, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9178176872107315078_1167, duration: 622508
2013-10-31 16:11:20,597 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9178176872107315078_1167 terminating
2013-10-31 16:11:20,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54905, dest: /127.0.0.1:41648, bytes: 28763, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9178176872107315078_1167, duration: 1396901
2013-10-31 16:11:20,598 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9178176872107315078_1167 terminating
2013-10-31 16:11:20,598 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34868, dest: /127.0.0.1:38271, bytes: 28763, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9178176872107315078_1167, duration: 2853736
2013-10-31 16:11:20,599 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9178176872107315078_1167 size 28763
2013-10-31 16:11:20,599 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9178176872107315078_1167 terminating
2013-10-31 16:11:20,601 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-9178176872107315078_1167 size 28763
2013-10-31 16:11:20,602 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_conf.xml from client DFSClient_37059141
2013-10-31 16:11:20,602 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_conf.xml is closed by DFSClient_37059141
2013-10-31 16:11:20,603 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9178176872107315078_1167 size 28763
2013-10-31 16:11:20,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,618 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken. blk_4981770940444099633_1168
2013-10-31 16:11:20,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4981770940444099633_1168 src: /127.0.0.1:54907 dest: /127.0.0.1:41648
2013-10-31 16:11:20,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4981770940444099633_1168 src: /127.0.0.1:34872 dest: /127.0.0.1:38271
2013-10-31 16:11:20,622 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4981770940444099633_1168 src: /127.0.0.1:47906 dest: /127.0.0.1:47311
2013-10-31 16:11:20,625 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47906, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4981770940444099633_1168, duration: 62550
2013-10-31 16:11:20,626 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4981770940444099633_1168 terminating
2013-10-31 16:11:20,626 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34872, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4981770940444099633_1168, duration: 827167
2013-10-31 16:11:20,626 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4981770940444099633_1168 terminating
2013-10-31 16:11:20,627 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4981770940444099633_1168 size 116
2013-10-31 16:11:20,627 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54907, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4981770940444099633_1168, duration: 1743774
2013-10-31 16:11:20,628 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4981770940444099633_1168 size 116
2013-10-31 16:11:20,628 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4981770940444099633_1168 terminating
2013-10-31 16:11:20,631 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4981770940444099633_1168 size 116
2013-10-31 16:11:20,631 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken from client DFSClient_1457307213
2013-10-31 16:11:20,632 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken is closed by DFSClient_1457307213
2013-10-31 16:11:20,638 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken
2013-10-31 16:11:20,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:11:20,642 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34805, bytes: 48, op: HDFS_READ, cliID: DFSClient_37059141, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2024600585106326716_1164, duration: 278413
2013-10-31 16:11:20,643 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0015 = 240. Number of splits = 1
2013-10-31 16:11:20,643 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:20,643 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:20,643 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:20,644 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0015 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:11:20,644 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0015 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 16:11:20,784 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0015_m_000002_0' to tip task_20131031160444934_0015_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:11:20,789 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000002_0'
2013-10-31 16:11:20,790 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000003_0'
2013-10-31 16:11:20,793 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0015_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:11:20,794 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0014
2013-10-31 16:11:20,794 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0015_m_000002_0 which needs 1 slots
2013-10-31 16:11:20,794 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0014 being deleted.
2013-10-31 16:11:20,794 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000004_0'
2013-10-31 16:11:20,794 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0015_m_000002_0 which needs 1 slots
2013-10-31 16:11:20,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken	dst=null	perm=null
2013-10-31 16:11:20,803 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34875, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4981770940444099633_1168, duration: 298341
2013-10-31 16:11:20,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml	dst=null	perm=null
2013-10-31 16:11:20,812 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34808, bytes: 28926, op: HDFS_READ, cliID: DFSClient_-262427717, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2522765479875883258_1165, duration: 391027
2013-10-31 16:11:20,843 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:20,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar	dst=null	perm=null
2013-10-31 16:11:20,881 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54914, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-262427717, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7182447276496863409_1162, duration: 1314861
2013-10-31 16:11:20,965 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0014_m_-1082003416
2013-10-31 16:11:20,972 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18266 with signal TERM. Exit code 0
2013-10-31 16:11:20,972 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0015_m_1034060197
2013-10-31 16:11:20,973 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0015_m_1034060197 spawned.
2013-10-31 16:11:20,974 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0015/attempt_20131031160444934_0015_m_000002_0/taskjvm.sh
2013-10-31 16:11:21,077 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:21,078 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:21,078 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:11:21,078 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-1082003416 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:21,231 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_7182447276496863409_1162 to datanode(s) 127.0.0.1:38271
2013-10-31 16:11:21,232 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_7144251647658547015_1159
2013-10-31 16:11:21,232 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_7144251647658547015_1159
2013-10-31 16:11:21,968 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7144251647658547015_1159 file build/test/data/dfs/data/data6/current/blk_7144251647658547015 for deletion
2013-10-31 16:11:21,968 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7144251647658547015_1159 at file build/test/data/dfs/data/data6/current/blk_7144251647658547015
2013-10-31 16:11:22,901 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0015_m_1034060197 given task: attempt_20131031160444934_0015_m_000002_0
2013-10-31 16:11:23,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:23,958 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_7182447276496863409_1162 to 127.0.0.1:38271 
2013-10-31 16:11:23,958 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7144251647658547015_1159 file build/test/data/dfs/data/data7/current/blk_7144251647658547015 for deletion
2013-10-31 16:11:23,959 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7144251647658547015_1159 at file build/test/data/dfs/data/data7/current/blk_7144251647658547015
2013-10-31 16:11:23,960 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7182447276496863409_1162 src: /127.0.0.1:34881 dest: /127.0.0.1:38271
2013-10-31 16:11:23,960 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_7182447276496863409_1162 to /127.0.0.1:38271
2013-10-31 16:11:23,963 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_7182447276496863409_1162 src: /127.0.0.1:34881 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:11:23,967 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7182447276496863409_1162 size 238055
2013-10-31 16:11:24,233 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_7144251647658547015_1159
2013-10-31 16:11:24,920 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0014
2013-10-31 16:11:24,921 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0014_m_000005_0 not found in cache
2013-10-31 16:11:24,922 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0014 for user-log deletion with retainTimeStamp:1383322284921
2013-10-31 16:11:25,635 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_r_-1113874899 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:25,646 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18505 with signal TERM. Exit code 0
2013-10-31 16:11:25,676 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_m_-1305407431 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:25,682 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18054 with signal TERM. Exit code 0
2013-10-31 16:11:25,794 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0014
2013-10-31 16:11:25,795 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0014 for user-log deletion with retainTimeStamp:1383322285795
2013-10-31 16:11:25,822 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:25,822 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:25,822 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:11:25,822 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_r_-1113874899 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:25,831 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0014
2013-10-31 16:11:25,831 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0014 for user-log deletion with retainTimeStamp:1383322285831
2013-10-31 16:11:25,850 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:25,850 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:25,850 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:11:25,851 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-1305407431 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:11:26,240 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_m_-291033684 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:26,250 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18195 with signal TERM. Exit code 0
2013-10-31 16:11:26,347 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000002_0 0.0% setup
2013-10-31 16:11:26,349 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0015_m_000002_0 is done.
2013-10-31 16:11:26,349 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0015_m_000002_0  was -1
2013-10-31 16:11:26,349 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:26,462 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:26,462 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:26,462 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:11:26,462 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-291033684 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:26,546 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_m_-766613114 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:26,556 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18262 with signal TERM. Exit code 0
2013-10-31 16:11:26,757 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7144251647658547015_1159 file build/test/data/dfs/data/data2/current/blk_7144251647658547015 for deletion
2013-10-31 16:11:26,757 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7144251647658547015_1159 at file build/test/data/dfs/data/data2/current/blk_7144251647658547015
2013-10-31 16:11:26,797 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:26,797 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:26,797 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:11:26,797 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-766613114 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:26,800 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0015_m_000002_0' has completed task_20131031160444934_0015_m_000002 successfully.
2013-10-31 16:11:26,802 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0015_m_000000_0' to tip task_20131031160444934_0015_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:11:26,803 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0015_m_000000
2013-10-31 16:11:26,805 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0015_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:11:26,805 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0015_m_000000_0 which needs 1 slots
2013-10-31 16:11:26,805 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0015_m_000000_0 which needs 1 slots
2013-10-31 16:11:26,825 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0015_m_1172956060
2013-10-31 16:11:26,825 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0015_m_1172956060 spawned.
2013-10-31 16:11:26,826 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0015/attempt_20131031160444934_0015_m_000000_0/taskjvm.sh
2013-10-31 16:11:27,274 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_m_-1646548683 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:27,282 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18360 with signal TERM. Exit code 0
2013-10-31 16:11:27,500 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:27,500 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:27,500 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:11:27,500 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-1646548683 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:27,987 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0015_m_1172956060 given task: attempt_20131031160444934_0015_m_000000_0
2013-10-31 16:11:28,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split	dst=null	perm=null
2013-10-31 16:11:28,517 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34815, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5457425651477839543_1163, duration: 267206
2013-10-31 16:11:28,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/part-00000	dst=null	perm=null
2013-10-31 16:11:28,554 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34885, bytes: 244, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8992668016065045310_1160, duration: 251325
2013-10-31 16:11:28,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:28,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:28,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 16:11:28,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 16:11:28,817 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34817, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5586763943079904199_1152, duration: 274952
2013-10-31 16:11:28,830 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000. blk_-8045400518665573082_1169
2013-10-31 16:11:28,867 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8045400518665573082_1169 src: /127.0.0.1:54923 dest: /127.0.0.1:41648
2013-10-31 16:11:28,868 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8045400518665573082_1169 src: /127.0.0.1:47921 dest: /127.0.0.1:47311
2013-10-31 16:11:28,869 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8045400518665573082_1169 src: /127.0.0.1:34820 dest: /127.0.0.1:50942
2013-10-31 16:11:28,871 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34820, dest: /127.0.0.1:50942, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8045400518665573082_1169, duration: 937199
2013-10-31 16:11:28,871 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8045400518665573082_1169 terminating
2013-10-31 16:11:28,871 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47921, dest: /127.0.0.1:47311, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8045400518665573082_1169, duration: 1293894
2013-10-31 16:11:28,871 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8045400518665573082_1169 terminating
2013-10-31 16:11:28,872 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54923, dest: /127.0.0.1:41648, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8045400518665573082_1169, duration: 1687003
2013-10-31 16:11:28,872 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8045400518665573082_1169 terminating
2013-10-31 16:11:28,873 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8045400518665573082_1169 size 70
2013-10-31 16:11:28,873 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8045400518665573082_1169 size 70
2013-10-31 16:11:28,875 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8045400518665573082_1169 size 70
2013-10-31 16:11:29,273 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0015_m_000000_0
2013-10-31 16:11:29,274 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0015_m_000000_0
2013-10-31 16:11:29,342 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0015_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:29,342 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000000_0 0.0% 
2013-10-31 16:11:29,809 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0015_m_000000_0
2013-10-31 16:11:30,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0	dst=null	perm=null
2013-10-31 16:11:30,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:30,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:30,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0	dst=null	perm=null
2013-10-31 16:11:31,446 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000000_0 1.0% hdfs://localhost:43856/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/part-00000:0+240
2013-10-31 16:11:31,448 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0015_m_000000_0 is done.
2013-10-31 16:11:31,448 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0015_m_000000_0  was -1
2013-10-31 16:11:31,449 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:31,805 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0015_m_000002_0
2013-10-31 16:11:31,805 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0015_m_000002_0
2013-10-31 16:11:31,806 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0015_m_000002_0 not found in cache
2013-10-31 16:11:32,812 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0015_m_000000_0' has completed task_20131031160444934_0015_m_000000 successfully.
2013-10-31 16:11:32,816 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0015_m_000001_0' to tip task_20131031160444934_0015_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:11:32,818 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0015_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:11:32,819 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0015_m_000001_0 which needs 1 slots
2013-10-31 16:11:32,819 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0015_m_000001_0 which needs 1 slots
2013-10-31 16:11:32,857 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0015/attempt_20131031160444934_0015_m_000001_0. Attempting to reuse: jvm_20131031160444934_0015_m_1172956060
2013-10-31 16:11:33,006 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0015_m_1172956060 given task: attempt_20131031160444934_0015_m_000001_0
2013-10-31 16:11:33,134 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000001_0 0.0% 
2013-10-31 16:11:33,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary	dst=null	perm=null
2013-10-31 16:11:33,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:33,148 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS from client DFSClient_attempt_20131031160444934_0015_m_000001_0
2013-10-31 16:11:33,148 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0015_m_000001_0
2013-10-31 16:11:33,154 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7182447276496863409 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:33,154 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7182447276496863409 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7182447276496863409 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7182447276496863409 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5457425651477839543 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5457425651477839543 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5457425651477839543 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5457425651477839543 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2024600585106326716 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2024600585106326716 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2024600585106326716 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2522765479875883258 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:33,155 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2522765479875883258 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:33,156 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2522765479875883258 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:33,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015	dst=null	perm=null
2013-10-31 16:11:33,234 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-2024600585106326716_1164 blk_2522765479875883258_1165 blk_5457425651477839543_1163 blk_7182447276496863409_1162
2013-10-31 16:11:33,234 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_2522765479875883258_1165 blk_5457425651477839543_1163 blk_7182447276496863409_1162
2013-10-31 16:11:33,359 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2522765479875883258_1165 file build/test/data/dfs/data/data4/current/blk_2522765479875883258 for deletion
2013-10-31 16:11:33,359 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5457425651477839543_1163 file build/test/data/dfs/data/data3/current/blk_5457425651477839543 for deletion
2013-10-31 16:11:33,359 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2522765479875883258_1165 at file build/test/data/dfs/data/data4/current/blk_2522765479875883258
2013-10-31 16:11:33,360 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7182447276496863409_1162 file build/test/data/dfs/data/data4/current/blk_7182447276496863409 for deletion
2013-10-31 16:11:33,360 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5457425651477839543_1163 at file build/test/data/dfs/data/data3/current/blk_5457425651477839543
2013-10-31 16:11:33,360 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7182447276496863409_1162 at file build/test/data/dfs/data/data4/current/blk_7182447276496863409
2013-10-31 16:11:35,760 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2024600585106326716_1164 file build/test/data/dfs/data/data1/current/blk_-2024600585106326716 for deletion
2013-10-31 16:11:35,760 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2522765479875883258_1165 file build/test/data/dfs/data/data2/current/blk_2522765479875883258 for deletion
2013-10-31 16:11:35,760 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2024600585106326716_1164 at file build/test/data/dfs/data/data1/current/blk_-2024600585106326716
2013-10-31 16:11:35,761 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5457425651477839543_1163 file build/test/data/dfs/data/data2/current/blk_5457425651477839543 for deletion
2013-10-31 16:11:35,761 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2522765479875883258_1165 at file build/test/data/dfs/data/data2/current/blk_2522765479875883258
2013-10-31 16:11:35,761 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7182447276496863409_1162 file build/test/data/dfs/data/data1/current/blk_7182447276496863409 for deletion
2013-10-31 16:11:35,761 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5457425651477839543_1163 at file build/test/data/dfs/data/data2/current/blk_5457425651477839543
2013-10-31 16:11:35,762 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7182447276496863409_1162 at file build/test/data/dfs/data/data1/current/blk_7182447276496863409
2013-10-31 16:11:36,108 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000001_0 0.0% cleanup
2013-10-31 16:11:36,110 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0015_m_000001_0 is done.
2013-10-31 16:11:36,110 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0015_m_000001_0  was -1
2013-10-31 16:11:36,111 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:36,235 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-2024600585106326716_1164 blk_5457425651477839543_1163 blk_7182447276496863409_1162
2013-10-31 16:11:36,235 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-2024600585106326716_1164 blk_2522765479875883258_1165 blk_5457425651477839543_1163 blk_7182447276496863409_1162
2013-10-31 16:11:36,973 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2024600585106326716_1164 file build/test/data/dfs/data/data5/current/blk_-2024600585106326716 for deletion
2013-10-31 16:11:36,973 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5457425651477839543_1163 file build/test/data/dfs/data/data6/current/blk_5457425651477839543 for deletion
2013-10-31 16:11:36,973 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2024600585106326716_1164 at file build/test/data/dfs/data/data5/current/blk_-2024600585106326716
2013-10-31 16:11:36,973 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7182447276496863409_1162 file build/test/data/dfs/data/data5/current/blk_7182447276496863409 for deletion
2013-10-31 16:11:36,973 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5457425651477839543_1163 at file build/test/data/dfs/data/data6/current/blk_5457425651477839543
2013-10-31 16:11:36,974 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7182447276496863409_1162 at file build/test/data/dfs/data/data5/current/blk_7182447276496863409
2013-10-31 16:11:38,825 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0015_m_000001_0' has completed task_20131031160444934_0015_m_000001 successfully.
2013-10-31 16:11:38,843 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0015 has completed successfully.
2013-10-31 16:11:38,844 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0015,submitTime=1383235880517,launchTime=1383235880644,firstMapTaskLaunchTime=1383235886802,firstJobSetupTaskLaunchTime=1383235880784,firstJobCleanupTaskLaunchTime=1383235892816,finishTime=1383235898843,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=13,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[EF9B8E00CB3E43349A0B2FF055BDD740/EF9B40A1CFD644CD9B429BCBF6B0FC8F] lower*upper*joined/(1/2) ...splatform/joingroupbyjoin
2013-10-31 16:11:38,890 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD. blk_-7948836075426741882_1170
2013-10-31 16:11:38,892 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7948836075426741882_1170 src: /127.0.0.1:34896 dest: /127.0.0.1:38271
2013-10-31 16:11:38,894 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7948836075426741882_1170 src: /127.0.0.1:54933 dest: /127.0.0.1:41648
2013-10-31 16:11:38,896 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7948836075426741882_1170 src: /127.0.0.1:47931 dest: /127.0.0.1:47311
2013-10-31 16:11:38,906 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47931, dest: /127.0.0.1:47311, bytes: 11338, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7948836075426741882_1170, duration: 4612425
2013-10-31 16:11:38,906 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7948836075426741882_1170 terminating
2013-10-31 16:11:38,907 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54933, dest: /127.0.0.1:41648, bytes: 11338, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7948836075426741882_1170, duration: 4495874
2013-10-31 16:11:38,907 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7948836075426741882_1170 terminating
2013-10-31 16:11:38,908 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34896, dest: /127.0.0.1:38271, bytes: 11338, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7948836075426741882_1170, duration: 7426770
2013-10-31 16:11:38,908 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7948836075426741882_1170 terminating
2013-10-31 16:11:38,908 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7948836075426741882_1170 size 11338
2013-10-31 16:11:38,911 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD from client DFSClient_37059141
2013-10-31 16:11:38,912 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD is closed by DFSClient_37059141
2013-10-31 16:11:38,912 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7948836075426741882_1170 size 11338
2013-10-31 16:11:38,913 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7948836075426741882_1170 size 11338
2013-10-31 16:11:38,920 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:11:38,921 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0015_m_000000_0'
2013-10-31 16:11:38,921 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0015_m_000001_0'
2013-10-31 16:11:38,921 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0015_m_000002_0'
2013-10-31 16:11:38,923 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4981770940444099633 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:38,923 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4981770940444099633 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:38,923 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4981770940444099633 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:38,925 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0015_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:11:38,928 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4576546115426846666 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:38,929 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4576546115426846666 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:38,929 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4576546115426846666 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:38,929 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8751337026572452485 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:38,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015	dst=null	perm=null
2013-10-31 16:11:38,929 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8751337026572452485 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:38,930 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8751337026572452485 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:38,930 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8992668016065045310 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:38,930 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8992668016065045310 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:38,931 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8992668016065045310 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:38,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84	dst=null	perm=null
2013-10-31 16:11:38,938 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary
2013-10-31 16:11:38,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2013-10-31 16:11:38,958 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:11:38,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2013-10-31 16:11:38,959 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0015
2013-10-31 16:11:38,959 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0015 being deleted.
2013-10-31 16:11:38,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2013-10-31 16:11:38,961 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54936, bytes: 74, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8045400518665573082_1169, duration: 290820
2013-10-31 16:11:38,962 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2024600585106326716_1164 file build/test/data/dfs/data/data8/current/blk_-2024600585106326716 for deletion
2013-10-31 16:11:38,962 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2522765479875883258_1165 file build/test/data/dfs/data/data7/current/blk_2522765479875883258 for deletion
2013-10-31 16:11:38,963 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5457425651477839543_1163 file build/test/data/dfs/data/data7/current/blk_5457425651477839543 for deletion
2013-10-31 16:11:38,963 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7182447276496863409_1162 file build/test/data/dfs/data/data8/current/blk_7182447276496863409 for deletion
2013-10-31 16:11:38,963 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2024600585106326716_1164 at file build/test/data/dfs/data/data8/current/blk_-2024600585106326716
2013-10-31 16:11:38,963 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2522765479875883258_1165 at file build/test/data/dfs/data/data7/current/blk_2522765479875883258
2013-10-31 16:11:38,963 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7182447276496863409_1162 at file build/test/data/dfs/data/data8/current/blk_7182447276496863409
2013-10-31 16:11:38,963 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5457425651477839543_1163 at file build/test/data/dfs/data/data7/current/blk_5457425651477839543
2013-10-31 16:11:38,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2013-10-31 16:11:38,969 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:11:38,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2013-10-31 16:11:38,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2013-10-31 16:11:38,973 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34832, bytes: 74, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8045400518665573082_1169, duration: 274564
2013-10-31 16:11:38,973 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joingroupbyjoin
2013-10-31 16:11:38,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2013-10-31 16:11:38,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2013-10-31 16:11:38,979 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47935, bytes: 74, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8045400518665573082_1169, duration: 175524
2013-10-31 16:11:38,991 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:11:38,991 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:11:39,003 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] starting
2013-10-31 16:11:39,003 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:11:39,003 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:11:39,004 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross"]
2013-10-31 16:11:39,004 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  parallel execution is enabled: true
2013-10-31 16:11:39,005 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  starting jobs: 1
2013-10-31 16:11:39,005 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  allocating threads: 1
2013-10-31 16:11:39,006 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] starting step: (1/1) ...ieldedpipesplatform/cross
2013-10-31 16:11:39,010 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:11:39,010 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:11:39,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:39,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:11:39,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,032 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar. blk_-8699900213099915514_1171
2013-10-31 16:11:39,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8699900213099915514_1171 src: /127.0.0.1:34834 dest: /127.0.0.1:50942
2013-10-31 16:11:39,035 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8699900213099915514_1171 src: /127.0.0.1:47937 dest: /127.0.0.1:47311
2013-10-31 16:11:39,037 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8699900213099915514_1171 src: /127.0.0.1:54941 dest: /127.0.0.1:41648
2013-10-31 16:11:39,044 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54941, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8699900213099915514_1171, duration: 3812164
2013-10-31 16:11:39,044 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8699900213099915514_1171 terminating
2013-10-31 16:11:39,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47937, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8699900213099915514_1171, duration: 4963423
2013-10-31 16:11:39,045 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8699900213099915514_1171 size 238055
2013-10-31 16:11:39,045 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8699900213099915514_1171 terminating
2013-10-31 16:11:39,046 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34834, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8699900213099915514_1171, duration: 5609811
2013-10-31 16:11:39,046 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8699900213099915514_1171 terminating
2013-10-31 16:11:39,049 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8699900213099915514_1171 size 238055
2013-10-31 16:11:39,049 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar from client DFSClient_1457307213
2013-10-31 16:11:39,050 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar is closed by DFSClient_1457307213
2013-10-31 16:11:39,050 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8699900213099915514_1171 size 238055
2013-10-31 16:11:39,055 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar. New replication is 10
2013-10-31 16:11:39,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar	dst=null	perm=null
2013-10-31 16:11:39,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,065 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:11:39,070 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:11:39,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:11:39,236 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-8699900213099915514_1171 to datanode(s) 127.0.0.1:38271
2013-10-31 16:11:39,236 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-8751337026572452485_1158 blk_-4576546115426846666_1161 blk_4981770940444099633_1168 blk_-8992668016065045310_1160
2013-10-31 16:11:39,237 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-8751337026572452485_1158 blk_-4576546115426846666_1161 blk_4981770940444099633_1168 blk_-8992668016065045310_1160
2013-10-31 16:11:39,361 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-8699900213099915514_1171 to 127.0.0.1:38271 
2013-10-31 16:11:39,361 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8992668016065045310_1160 file build/test/data/dfs/data/data4/current/blk_-8992668016065045310 for deletion
2013-10-31 16:11:39,362 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8751337026572452485_1158 file build/test/data/dfs/data/data3/current/blk_-8751337026572452485 for deletion
2013-10-31 16:11:39,362 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8992668016065045310_1160 at file build/test/data/dfs/data/data4/current/blk_-8992668016065045310
2013-10-31 16:11:39,362 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4576546115426846666_1161 file build/test/data/dfs/data/data3/current/blk_-4576546115426846666 for deletion
2013-10-31 16:11:39,362 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8751337026572452485_1158 at file build/test/data/dfs/data/data3/current/blk_-8751337026572452485
2013-10-31 16:11:39,363 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8699900213099915514_1171 src: /127.0.0.1:34906 dest: /127.0.0.1:38271
2013-10-31 16:11:39,363 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4576546115426846666_1161 at file build/test/data/dfs/data/data3/current/blk_-4576546115426846666
2013-10-31 16:11:39,363 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-8699900213099915514_1171 to /127.0.0.1:38271
2013-10-31 16:11:39,362 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4981770940444099633_1168 file build/test/data/dfs/data/data3/current/blk_4981770940444099633 for deletion
2013-10-31 16:11:39,364 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4981770940444099633_1168 at file build/test/data/dfs/data/data3/current/blk_4981770940444099633
2013-10-31 16:11:39,366 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8699900213099915514_1171 src: /127.0.0.1:34906 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:11:39,370 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8699900213099915514_1171 size 238055
2013-10-31 16:11:39,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,741 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split. New replication is 10
2013-10-31 16:11:39,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split	dst=null	perm=null
2013-10-31 16:11:39,747 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split. blk_-1537610290047334833_1172
2013-10-31 16:11:39,749 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1537610290047334833_1172 src: /127.0.0.1:47940 dest: /127.0.0.1:47311
2013-10-31 16:11:39,751 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1537610290047334833_1172 src: /127.0.0.1:34839 dest: /127.0.0.1:50942
2013-10-31 16:11:39,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1537610290047334833_1172 src: /127.0.0.1:54945 dest: /127.0.0.1:41648
2013-10-31 16:11:39,754 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1537610290047334833_1172 src: /127.0.0.1:34910 dest: /127.0.0.1:38271
2013-10-31 16:11:39,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34910, dest: /127.0.0.1:38271, bytes: 1379, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1537610290047334833_1172, duration: 108177
2013-10-31 16:11:39,758 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1537610290047334833_1172 terminating
2013-10-31 16:11:39,759 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54945, dest: /127.0.0.1:41648, bytes: 1379, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1537610290047334833_1172, duration: 962168
2013-10-31 16:11:39,759 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1537610290047334833_1172 terminating
2013-10-31 16:11:39,760 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34839, dest: /127.0.0.1:50942, bytes: 1379, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1537610290047334833_1172, duration: 2182635
2013-10-31 16:11:39,760 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1537610290047334833_1172 size 1379
2013-10-31 16:11:39,760 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1537610290047334833_1172 terminating
2013-10-31 16:11:39,761 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47940, dest: /127.0.0.1:47311, bytes: 1379, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1537610290047334833_1172, duration: 3155309
2013-10-31 16:11:39,761 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-1537610290047334833_1172 terminating
2013-10-31 16:11:39,763 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1537610290047334833_1172 size 1379
2013-10-31 16:11:39,763 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split from client DFSClient_1457307213
2013-10-31 16:11:39,764 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split is closed by DFSClient_1457307213
2013-10-31 16:11:39,764 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1537610290047334833_1172 size 1379
2013-10-31 16:11:39,765 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1537610290047334833_1172 size 1379
2013-10-31 16:11:39,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,787 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo. blk_-8495043711673365996_1173
2013-10-31 16:11:39,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8495043711673365996_1173 src: /127.0.0.1:34842 dest: /127.0.0.1:50942
2013-10-31 16:11:39,790 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8495043711673365996_1173 src: /127.0.0.1:34912 dest: /127.0.0.1:38271
2013-10-31 16:11:39,791 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8495043711673365996_1173 src: /127.0.0.1:47946 dest: /127.0.0.1:47311
2013-10-31 16:11:39,794 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47946, dest: /127.0.0.1:47311, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8495043711673365996_1173, duration: 62347
2013-10-31 16:11:39,795 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8495043711673365996_1173 terminating
2013-10-31 16:11:39,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34912, dest: /127.0.0.1:38271, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8495043711673365996_1173, duration: 925256
2013-10-31 16:11:39,795 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8495043711673365996_1173 terminating
2013-10-31 16:11:39,796 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34842, dest: /127.0.0.1:50942, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8495043711673365996_1173, duration: 1739249
2013-10-31 16:11:39,796 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8495043711673365996_1173 terminating
2013-10-31 16:11:39,796 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8495043711673365996_1173 size 148
2013-10-31 16:11:39,800 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8495043711673365996_1173 size 148
2013-10-31 16:11:39,803 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:11:39,803 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:11:39,804 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8495043711673365996_1173 size 148
2013-10-31 16:11:39,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,832 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml. blk_5829433608470320000_1174
2013-10-31 16:11:39,833 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829433608470320000_1174 src: /127.0.0.1:54950 dest: /127.0.0.1:41648
2013-10-31 16:11:39,835 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829433608470320000_1174 src: /127.0.0.1:47948 dest: /127.0.0.1:47311
2013-10-31 16:11:39,837 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829433608470320000_1174 src: /127.0.0.1:34916 dest: /127.0.0.1:38271
2013-10-31 16:11:39,840 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34916, dest: /127.0.0.1:38271, bytes: 28244, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5829433608470320000_1174, duration: 107499
2013-10-31 16:11:39,840 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5829433608470320000_1174 terminating
2013-10-31 16:11:39,840 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47948, dest: /127.0.0.1:47311, bytes: 28244, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5829433608470320000_1174, duration: 956210
2013-10-31 16:11:39,841 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5829433608470320000_1174 terminating
2013-10-31 16:11:39,841 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54950, dest: /127.0.0.1:41648, bytes: 28244, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5829433608470320000_1174, duration: 2038163
2013-10-31 16:11:39,842 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5829433608470320000_1174 terminating
2013-10-31 16:11:39,844 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5829433608470320000_1174 size 28244
2013-10-31 16:11:39,844 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml from client DFSClient_1457307213
2013-10-31 16:11:39,845 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml is closed by DFSClient_1457307213
2013-10-31 16:11:39,845 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5829433608470320000_1174 size 28244
2013-10-31 16:11:39,846 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5829433608470320000_1174 size 28244
2013-10-31 16:11:39,849 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:11:39,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml	dst=null	perm=null
2013-10-31 16:11:39,859 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,861 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47951, bytes: 28468, op: HDFS_READ, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5829433608470320000_1174, duration: 377959
2013-10-31 16:11:39,865 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,871 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,877 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,878 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0016: nMaps=4 nReduces=0 max=-1
2013-10-31 16:11:39,878 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0016 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:11:39,878 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0016
2013-10-31 16:11:39,878 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0016	RESULT=SUCCESS
2013-10-31 16:11:39,879 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0016
2013-10-31 16:11:39,880 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] submitted hadoop job: job_20131031160444934_0016
2013-10-31 16:11:39,883 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,889 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,889 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:11:39,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,902 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_conf.xml. blk_-1017080296582285540_1176
2013-10-31 16:11:39,903 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1017080296582285540_1176 src: /127.0.0.1:54955 dest: /127.0.0.1:41648
2013-10-31 16:11:39,904 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1017080296582285540_1176 src: /127.0.0.1:47953 dest: /127.0.0.1:47311
2013-10-31 16:11:39,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1017080296582285540_1176 src: /127.0.0.1:34852 dest: /127.0.0.1:50942
2013-10-31 16:11:39,908 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34852, dest: /127.0.0.1:50942, bytes: 28309, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1017080296582285540_1176, duration: 1740141
2013-10-31 16:11:39,908 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1017080296582285540_1176 terminating
2013-10-31 16:11:39,908 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1017080296582285540_1176 size 28309
2013-10-31 16:11:39,909 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47953, dest: /127.0.0.1:47311, bytes: 28309, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1017080296582285540_1176, duration: 1158899
2013-10-31 16:11:39,909 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1017080296582285540_1176 terminating
2013-10-31 16:11:39,909 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54955, dest: /127.0.0.1:41648, bytes: 28309, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1017080296582285540_1176, duration: 2762881
2013-10-31 16:11:39,909 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1017080296582285540_1176 terminating
2013-10-31 16:11:39,911 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_conf.xml from client DFSClient_-1991226254
2013-10-31 16:11:39,911 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_conf.xml is closed by DFSClient_-1991226254
2013-10-31 16:11:39,911 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1017080296582285540_1176 size 28309
2013-10-31 16:11:39,913 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1017080296582285540_1176 size 28309
2013-10-31 16:11:39,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,929 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken. blk_7194689012869079137_1177
2013-10-31 16:11:39,930 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7194689012869079137_1177 src: /127.0.0.1:47955 dest: /127.0.0.1:47311
2013-10-31 16:11:39,932 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7194689012869079137_1177 src: /127.0.0.1:34923 dest: /127.0.0.1:38271
2013-10-31 16:11:39,933 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7194689012869079137_1177 src: /127.0.0.1:34855 dest: /127.0.0.1:50942
2013-10-31 16:11:39,936 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34855, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7194689012869079137_1177, duration: 64497
2013-10-31 16:11:39,937 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7194689012869079137_1177 terminating
2013-10-31 16:11:39,937 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7194689012869079137_1177 size 116
2013-10-31 16:11:39,937 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34923, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7194689012869079137_1177, duration: 815185
2013-10-31 16:11:39,938 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7194689012869079137_1177 terminating
2013-10-31 16:11:39,938 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47955, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7194689012869079137_1177, duration: 1640580
2013-10-31 16:11:39,939 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7194689012869079137_1177 terminating
2013-10-31 16:11:39,941 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7194689012869079137_1177 size 116
2013-10-31 16:11:39,942 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken from client DFSClient_1457307213
2013-10-31 16:11:39,942 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken is closed by DFSClient_1457307213
2013-10-31 16:11:39,943 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7194689012869079137_1177 size 116
2013-10-31 16:11:39,949 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken
2013-10-31 16:11:39,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:11:39,953 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34856, bytes: 152, op: HDFS_READ, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8495043711673365996_1173, duration: 272890
2013-10-31 16:11:39,954 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0016 = 52. Number of splits = 4
2013-10-31 16:11:39,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,956 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,956 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,956 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,956 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,957 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,957 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,957 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,957 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0016 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:11:39,958 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0016 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 16:11:39,974 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8992668016065045310_1160 file build/test/data/dfs/data/data5/current/blk_-8992668016065045310 for deletion
2013-10-31 16:11:39,974 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8751337026572452485_1158 file build/test/data/dfs/data/data5/current/blk_-8751337026572452485 for deletion
2013-10-31 16:11:39,974 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8992668016065045310_1160 at file build/test/data/dfs/data/data5/current/blk_-8992668016065045310
2013-10-31 16:11:39,975 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4576546115426846666_1161 file build/test/data/dfs/data/data6/current/blk_-4576546115426846666 for deletion
2013-10-31 16:11:39,975 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8751337026572452485_1158 at file build/test/data/dfs/data/data5/current/blk_-8751337026572452485
2013-10-31 16:11:39,975 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4576546115426846666_1161 at file build/test/data/dfs/data/data6/current/blk_-4576546115426846666
2013-10-31 16:11:39,975 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4981770940444099633_1168 file build/test/data/dfs/data/data5/current/blk_4981770940444099633 for deletion
2013-10-31 16:11:39,976 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4981770940444099633_1168 at file build/test/data/dfs/data/data5/current/blk_4981770940444099633
2013-10-31 16:11:40,945 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0016_m_000005_0' to tip task_20131031160444934_0016_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:11:40,951 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:11:40,952 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0015
2013-10-31 16:11:40,952 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000005_0 which needs 1 slots
2013-10-31 16:11:40,952 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0015 being deleted.
2013-10-31 16:11:40,952 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000005_0 which needs 1 slots
2013-10-31 16:11:40,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken	dst=null	perm=null
2013-10-31 16:11:40,961 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34926, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7194689012869079137_1177, duration: 303041
2013-10-31 16:11:40,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml	dst=null	perm=null
2013-10-31 16:11:40,975 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54964, bytes: 28468, op: HDFS_READ, cliID: DFSClient_876369485, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5829433608470320000_1174, duration: 432809
2013-10-31 16:11:41,005 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:41,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar	dst=null	perm=null
2013-10-31 16:11:41,030 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54965, bytes: 239915, op: HDFS_READ, cliID: DFSClient_876369485, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8699900213099915514_1171, duration: 1358248
2013-10-31 16:11:41,140 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_2092185245
2013-10-31 16:11:41,140 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_2092185245 spawned.
2013-10-31 16:11:41,141 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000005_0/taskjvm.sh
2013-10-31 16:11:41,814 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0015
2013-10-31 16:11:41,814 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0015 being deleted.
2013-10-31 16:11:42,237 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-8751337026572452485_1158 blk_-4576546115426846666_1161
2013-10-31 16:11:42,237 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_4981770940444099633_1168 blk_-8992668016065045310_1160
2013-10-31 16:11:42,472 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_2092185245 given task: attempt_20131031160444934_0016_m_000005_0
2013-10-31 16:11:43,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:43,923 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0015
2013-10-31 16:11:43,923 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0015_m_000000_0 not found in cache
2013-10-31 16:11:43,924 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0015_m_000001_0 not found in cache
2013-10-31 16:11:43,924 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0015 for user-log deletion with retainTimeStamp:1383322303924
2013-10-31 16:11:44,151 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0015_m_1172956060 since job job_20131031160444934_0015 is dead
2013-10-31 16:11:44,162 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18837 with signal TERM. Exit code 0
2013-10-31 16:11:44,333 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:44,333 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:44,333 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:11:44,333 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0015_m_1172956060 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:11:44,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8992668016065045310_1160 file build/test/data/dfs/data/data1/current/blk_-8992668016065045310 for deletion
2013-10-31 16:11:44,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4981770940444099633_1168 file build/test/data/dfs/data/data2/current/blk_4981770940444099633 for deletion
2013-10-31 16:11:44,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8992668016065045310_1160 at file build/test/data/dfs/data/data1/current/blk_-8992668016065045310
2013-10-31 16:11:44,764 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4981770940444099633_1168 at file build/test/data/dfs/data/data2/current/blk_4981770940444099633
2013-10-31 16:11:44,919 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0015_m_1034060197 since job job_20131031160444934_0015 is dead
2013-10-31 16:11:44,929 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18710 with signal TERM. Exit code 0
2013-10-31 16:11:44,964 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8751337026572452485_1158 file build/test/data/dfs/data/data8/current/blk_-8751337026572452485 for deletion
2013-10-31 16:11:44,965 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4576546115426846666_1161 file build/test/data/dfs/data/data7/current/blk_-4576546115426846666 for deletion
2013-10-31 16:11:44,965 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8751337026572452485_1158 at file build/test/data/dfs/data/data8/current/blk_-8751337026572452485
2013-10-31 16:11:44,965 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4576546115426846666_1161 at file build/test/data/dfs/data/data7/current/blk_-4576546115426846666
2013-10-31 16:11:45,104 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:45,104 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:45,104 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:11:45,104 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0015_m_1034060197 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:45,914 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000005_0 0.0% setup
2013-10-31 16:11:45,916 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000005_0 is done.
2013-10-31 16:11:45,917 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000005_0  was -1
2013-10-31 16:11:45,917 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:46,958 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000005_0' has completed task_20131031160444934_0016_m_000005 successfully.
2013-10-31 16:11:47,072 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0016_m_000000_0' to tip task_20131031160444934_0016_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:11:47,073 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0016_m_000000
2013-10-31 16:11:47,075 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:11:47,075 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000000_0 which needs 1 slots
2013-10-31 16:11:47,075 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000000_0 which needs 1 slots
2013-10-31 16:11:47,162 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_-768505707
2013-10-31 16:11:47,163 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_-768505707 spawned.
2013-10-31 16:11:47,166 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000000_0/taskjvm.sh
2013-10-31 16:11:47,822 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0016_m_000001_0' to tip task_20131031160444934_0016_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:11:47,823 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0016_m_000001
2013-10-31 16:11:47,824 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:11:47,825 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000001_0 which needs 1 slots
2013-10-31 16:11:47,825 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000001_0 which needs 1 slots
2013-10-31 16:11:47,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken	dst=null	perm=null
2013-10-31 16:11:47,831 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47966, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7194689012869079137_1177, duration: 142507
2013-10-31 16:11:47,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml	dst=null	perm=null
2013-10-31 16:11:47,841 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34935, bytes: 28468, op: HDFS_READ, cliID: DFSClient_-1217873459, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5829433608470320000_1174, duration: 477032
2013-10-31 16:11:47,862 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:47,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar	dst=null	perm=null
2013-10-31 16:11:47,875 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34936, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1217873459, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8699900213099915514_1171, duration: 636581
2013-10-31 16:11:47,927 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_-2031316218
2013-10-31 16:11:47,927 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_-2031316218 spawned.
2013-10-31 16:11:47,928 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000001_0/taskjvm.sh
2013-10-31 16:11:47,934 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0016_m_000002_0' to tip task_20131031160444934_0016_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:11:47,934 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0016_m_000002
2013-10-31 16:11:47,935 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:11:47,935 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000002_0 which needs 1 slots
2013-10-31 16:11:47,935 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000002_0 which needs 1 slots
2013-10-31 16:11:47,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken	dst=null	perm=null
2013-10-31 16:11:47,939 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47970, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7194689012869079137_1177, duration: 136319
2013-10-31 16:11:47,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml	dst=null	perm=null
2013-10-31 16:11:47,943 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34939, bytes: 28468, op: HDFS_READ, cliID: DFSClient_-2100221565, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5829433608470320000_1174, duration: 153701
2013-10-31 16:11:47,955 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:47,969 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0016_m_000003_0' to tip task_20131031160444934_0016_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:11:47,969 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0016_m_000003
2013-10-31 16:11:47,970 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:11:47,970 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000003_0 which needs 1 slots
2013-10-31 16:11:47,970 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000003_0 which needs 1 slots
2013-10-31 16:11:47,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken	dst=null	perm=null
2013-10-31 16:11:47,974 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34940, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7194689012869079137_1177, duration: 144422
2013-10-31 16:11:47,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar	dst=null	perm=null
2013-10-31 16:11:47,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml	dst=null	perm=null
2013-10-31 16:11:47,979 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54978, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2100221565, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8699900213099915514_1171, duration: 691957
2013-10-31 16:11:47,979 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47976, bytes: 28468, op: HDFS_READ, cliID: DFSClient_753679354, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5829433608470320000_1174, duration: 161069
2013-10-31 16:11:47,991 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_-768505707 given task: attempt_20131031160444934_0016_m_000000_0
2013-10-31 16:11:47,992 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:48,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar	dst=null	perm=null
2013-10-31 16:11:48,006 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47977, bytes: 239915, op: HDFS_READ, cliID: DFSClient_753679354, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8699900213099915514_1171, duration: 740192
2013-10-31 16:11:48,257 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_1360879598
2013-10-31 16:11:48,257 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_-383608023
2013-10-31 16:11:48,258 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_1360879598 spawned.
2013-10-31 16:11:48,259 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_-383608023 spawned.
2013-10-31 16:11:48,260 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000002_0/taskjvm.sh
2013-10-31 16:11:48,261 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000003_0/taskjvm.sh
2013-10-31 16:11:48,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split	dst=null	perm=null
2013-10-31 16:11:48,808 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54982, bytes: 1391, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1537610290047334833_1172, duration: 174886
2013-10-31 16:11:48,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:11:48,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:48,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:49,037 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_-2031316218 given task: attempt_20131031160444934_0016_m_000001_0
2013-10-31 16:11:49,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:11:49,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:11:49,124 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47981, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 136729
2013-10-31 16:11:49,128 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34880, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 138847
2013-10-31 16:11:49,136 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000. blk_-1338531806484752498_1178
2013-10-31 16:11:49,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1338531806484752498_1178 src: /127.0.0.1:34881 dest: /127.0.0.1:50942
2013-10-31 16:11:49,161 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1338531806484752498_1178 src: /127.0.0.1:47984 dest: /127.0.0.1:47311
2013-10-31 16:11:49,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1338531806484752498_1178 src: /127.0.0.1:34952 dest: /127.0.0.1:38271
2013-10-31 16:11:49,164 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34952, dest: /127.0.0.1:38271, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1338531806484752498_1178, duration: 1166512
2013-10-31 16:11:49,165 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1338531806484752498_1178 terminating
2013-10-31 16:11:49,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47984, dest: /127.0.0.1:47311, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1338531806484752498_1178, duration: 1639266
2013-10-31 16:11:49,165 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1338531806484752498_1178 terminating
2013-10-31 16:11:49,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34881, dest: /127.0.0.1:50942, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1338531806484752498_1178, duration: 2026898
2013-10-31 16:11:49,166 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1338531806484752498_1178 terminating
2013-10-31 16:11:49,169 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1338531806484752498_1178 size 96
2013-10-31 16:11:49,169 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1338531806484752498_1178 size 96
2013-10-31 16:11:49,169 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1338531806484752498_1178 size 96
2013-10-31 16:11:49,470 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_1360879598 given task: attempt_20131031160444934_0016_m_000002_0
2013-10-31 16:11:49,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split	dst=null	perm=null
2013-10-31 16:11:49,537 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34887, bytes: 1391, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1537610290047334833_1172, duration: 173499
2013-10-31 16:11:49,563 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_-383608023 given task: attempt_20131031160444934_0016_m_000003_0
2013-10-31 16:11:49,567 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0016_m_000000_0
2013-10-31 16:11:49,567 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0016_m_000000_0
2013-10-31 16:11:49,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:11:49,577 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34957, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 124479
2013-10-31 16:11:49,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:49,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:49,615 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0016_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:49,615 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000000_0 0.0% 
2013-10-31 16:11:49,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:11:49,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:11:49,814 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54994, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 128050
2013-10-31 16:11:49,824 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001. blk_-3174711439536184192_1179
2013-10-31 16:11:49,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3174711439536184192_1179 src: /127.0.0.1:34890 dest: /127.0.0.1:50942
2013-10-31 16:11:49,849 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3174711439536184192_1179 src: /127.0.0.1:47993 dest: /127.0.0.1:47311
2013-10-31 16:11:49,849 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3174711439536184192_1179 src: /127.0.0.1:54997 dest: /127.0.0.1:41648
2013-10-31 16:11:49,852 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54997, dest: /127.0.0.1:41648, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3174711439536184192_1179, duration: 1110346
2013-10-31 16:11:49,852 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3174711439536184192_1179 terminating
2013-10-31 16:11:49,852 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47993, dest: /127.0.0.1:47311, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3174711439536184192_1179, duration: 1486321
2013-10-31 16:11:49,852 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3174711439536184192_1179 terminating
2013-10-31 16:11:49,852 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34890, dest: /127.0.0.1:50942, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3174711439536184192_1179, duration: 1879149
2013-10-31 16:11:49,852 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3174711439536184192_1179 terminating
2013-10-31 16:11:49,854 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3174711439536184192_1179 size 56
2013-10-31 16:11:49,854 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3174711439536184192_1179 size 56
2013-10-31 16:11:49,856 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3174711439536184192_1179 size 56
2013-10-31 16:11:49,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split	dst=null	perm=null
2013-10-31 16:11:49,989 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34964, bytes: 875, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1537610290047334833_1172, duration: 167058
2013-10-31 16:11:50,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:11:50,028 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34896, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 103975
2013-10-31 16:11:50,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:50,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:50,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split	dst=null	perm=null
2013-10-31 16:11:50,059 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34897, bytes: 359, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1537610290047334833_1172, duration: 120740
2013-10-31 16:11:50,076 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0016_m_000000_0
2013-10-31 16:11:50,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:11:50,098 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34898, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 115463
2013-10-31 16:11:50,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:50,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:50,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:11:50,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:11:50,249 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48001, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 124865
2013-10-31 16:11:50,254 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0016_m_000001_0
2013-10-31 16:11:50,254 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0016_m_000001_0
2013-10-31 16:11:50,259 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002. blk_-6105123511850759531_1181
2013-10-31 16:11:50,282 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6105123511850759531_1181 src: /127.0.0.1:55005 dest: /127.0.0.1:41648
2013-10-31 16:11:50,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6105123511850759531_1181 src: /127.0.0.1:48003 dest: /127.0.0.1:47311
2013-10-31 16:11:50,284 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6105123511850759531_1181 src: /127.0.0.1:34902 dest: /127.0.0.1:50942
2013-10-31 16:11:50,286 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34902, dest: /127.0.0.1:50942, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6105123511850759531_1181, duration: 1122754
2013-10-31 16:11:50,286 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6105123511850759531_1181 terminating
2013-10-31 16:11:50,287 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48003, dest: /127.0.0.1:47311, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6105123511850759531_1181, duration: 1656681
2013-10-31 16:11:50,287 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6105123511850759531_1181 terminating
2013-10-31 16:11:50,287 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55005, dest: /127.0.0.1:41648, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6105123511850759531_1181, duration: 2179614
2013-10-31 16:11:50,287 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6105123511850759531_1181 terminating
2013-10-31 16:11:50,291 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6105123511850759531_1181 size 72
2013-10-31 16:11:50,291 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6105123511850759531_1181 size 72
2013-10-31 16:11:50,291 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6105123511850759531_1181 size 72
2013-10-31 16:11:50,301 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0016_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:50,301 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000001_0 0.0% 
2013-10-31 16:11:50,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:11:50,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:11:50,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48005, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 133062
2013-10-31 16:11:50,331 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003. blk_-4235132370181600024_1181
2013-10-31 16:11:50,353 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235132370181600024_1181 src: /127.0.0.1:34973 dest: /127.0.0.1:38271
2013-10-31 16:11:50,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235132370181600024_1181 src: /127.0.0.1:55010 dest: /127.0.0.1:41648
2013-10-31 16:11:50,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235132370181600024_1181 src: /127.0.0.1:48008 dest: /127.0.0.1:47311
2013-10-31 16:11:50,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48008, dest: /127.0.0.1:47311, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4235132370181600024_1181, duration: 1188732
2013-10-31 16:11:50,357 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4235132370181600024_1181 terminating
2013-10-31 16:11:50,357 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4235132370181600024_1181 size 72
2013-10-31 16:11:50,358 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55010, dest: /127.0.0.1:41648, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4235132370181600024_1181, duration: 1956439
2013-10-31 16:11:50,358 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4235132370181600024_1181 terminating
2013-10-31 16:11:50,359 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34973, dest: /127.0.0.1:38271, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4235132370181600024_1181, duration: 2948088
2013-10-31 16:11:50,360 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4235132370181600024_1181 terminating
2013-10-31 16:11:50,360 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4235132370181600024_1181 size 72
2013-10-31 16:11:50,361 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0016_m_000003_0
2013-10-31 16:11:50,361 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0016_m_000003_0
2013-10-31 16:11:50,361 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4235132370181600024_1181 size 72
2013-10-31 16:11:50,412 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0016_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:50,412 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000003_0 0.0% 
2013-10-31 16:11:50,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0	dst=null	perm=null
2013-10-31 16:11:50,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:50,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:50,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0	dst=null	perm=null
2013-10-31 16:11:50,689 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0016_m_000002_0
2013-10-31 16:11:50,690 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0016_m_000002_0
2013-10-31 16:11:50,749 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0016_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:50,749 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000002_0 0.0% 
2013-10-31 16:11:50,830 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0016_m_000001_0
2013-10-31 16:11:50,939 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0016_m_000002_0
2013-10-31 16:11:50,973 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0016_m_000003_0
2013-10-31 16:11:51,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0	dst=null	perm=null
2013-10-31 16:11:51,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:51,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:51,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0	dst=null	perm=null
2013-10-31 16:11:51,645 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 960 Total time for transactions(ms): 17Number of transactions batched in Syncs: 89 Number of syncs: 684 SyncTimes(ms): 27108 3567 
2013-10-31 16:11:51,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:51,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0	dst=null	perm=null
2013-10-31 16:11:51,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:51,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0	dst=null	perm=null
2013-10-31 16:11:51,735 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+13
2013-10-31 16:11:51,737 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000000_0 is done.
2013-10-31 16:11:51,737 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000000_0  was -1
2013-10-31 16:11:51,737 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:51,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0	dst=null	perm=null
2013-10-31 16:11:51,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:51,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:51,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0	dst=null	perm=null
2013-10-31 16:11:52,075 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0016_m_000005_0
2013-10-31 16:11:52,076 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0016_m_000005_0
2013-10-31 16:11:52,076 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000005_0 not found in cache
2013-10-31 16:11:52,463 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:13+13
2013-10-31 16:11:52,465 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000001_0 is done.
2013-10-31 16:11:52,465 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000001_0  was -1
2013-10-31 16:11:52,465 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:52,896 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+13
2013-10-31 16:11:52,898 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000002_0 is done.
2013-10-31 16:11:52,898 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000002_0  was -1
2013-10-31 16:11:52,899 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:52,985 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:39+13
2013-10-31 16:11:52,986 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000003_0 is done.
2013-10-31 16:11:52,986 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000003_0  was -1
2013-10-31 16:11:52,986 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:53,078 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000000_0' has completed task_20131031160444934_0016_m_000000 successfully.
2013-10-31 16:11:53,832 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000001_0' has completed task_20131031160444934_0016_m_000001 successfully.
2013-10-31 16:11:53,942 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000002_0' has completed task_20131031160444934_0016_m_000002 successfully.
2013-10-31 16:11:53,977 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000003_0' has completed task_20131031160444934_0016_m_000003 successfully.
2013-10-31 16:11:53,981 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0016_m_000004_0' to tip task_20131031160444934_0016_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:11:53,983 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:11:53,983 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000004_0 which needs 1 slots
2013-10-31 16:11:53,984 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000004_0 which needs 1 slots
2013-10-31 16:11:54,022 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_-890241865
2013-10-31 16:11:54,023 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_-890241865 spawned.
2013-10-31 16:11:54,026 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000004_0/taskjvm.sh
2013-10-31 16:11:54,900 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_-890241865 given task: attempt_20131031160444934_0016_m_000004_0
2013-10-31 16:11:55,412 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000004_0 0.0% 
2013-10-31 16:11:55,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary	dst=null	perm=null
2013-10-31 16:11:55,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:55,434 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_SUCCESS from client DFSClient_attempt_20131031160444934_0016_m_000004_0
2013-10-31 16:11:55,434 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0016_m_000004_0
2013-10-31 16:11:55,441 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8699900213099915514 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:55,441 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8699900213099915514 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:55,441 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8699900213099915514 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:55,442 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8699900213099915514 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:55,442 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1537610290047334833 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:55,442 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1537610290047334833 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:55,442 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1537610290047334833 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:55,442 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1537610290047334833 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:55,442 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8495043711673365996 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:55,443 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8495043711673365996 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:55,443 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8495043711673365996 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:55,443 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5829433608470320000 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:55,443 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5829433608470320000 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:55,443 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5829433608470320000 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:55,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016	dst=null	perm=null
2013-10-31 16:11:56,923 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-3591799862562816615_1055
2013-10-31 16:11:57,240 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_5829433608470320000_1174 blk_-1537610290047334833_1172 blk_-8699900213099915514_1171
2013-10-31 16:11:57,240 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-1537610290047334833_1172 blk_-8699900213099915514_1171 blk_-8495043711673365996_1173
2013-10-31 16:11:57,980 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8699900213099915514_1171 file build/test/data/dfs/data/data6/current/blk_-8699900213099915514 for deletion
2013-10-31 16:11:57,980 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1537610290047334833_1172 file build/test/data/dfs/data/data5/current/blk_-1537610290047334833 for deletion
2013-10-31 16:11:57,980 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5829433608470320000_1174 file build/test/data/dfs/data/data6/current/blk_5829433608470320000 for deletion
2013-10-31 16:11:57,981 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1537610290047334833_1172 at file build/test/data/dfs/data/data5/current/blk_-1537610290047334833
2013-10-31 16:11:57,980 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8699900213099915514_1171 at file build/test/data/dfs/data/data6/current/blk_-8699900213099915514
2013-10-31 16:11:57,981 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5829433608470320000_1174 at file build/test/data/dfs/data/data6/current/blk_5829433608470320000
2013-10-31 16:11:58,341 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000004_0 0.0% cleanup
2013-10-31 16:11:58,343 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000004_0 is done.
2013-10-31 16:11:58,343 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000004_0  was -1
2013-10-31 16:11:58,343 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:59,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8699900213099915514_1171 file build/test/data/dfs/data/data8/current/blk_-8699900213099915514 for deletion
2013-10-31 16:11:59,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8495043711673365996_1173 file build/test/data/dfs/data/data8/current/blk_-8495043711673365996 for deletion
2013-10-31 16:11:59,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8699900213099915514_1171 at file build/test/data/dfs/data/data8/current/blk_-8699900213099915514
2013-10-31 16:11:59,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1537610290047334833_1172 file build/test/data/dfs/data/data7/current/blk_-1537610290047334833 for deletion
2013-10-31 16:11:59,972 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8495043711673365996_1173 at file build/test/data/dfs/data/data8/current/blk_-8495043711673365996
2013-10-31 16:11:59,972 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1537610290047334833_1172 at file build/test/data/dfs/data/data7/current/blk_-1537610290047334833
2013-10-31 16:11:59,991 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000004_0' has completed task_20131031160444934_0016_m_000004 successfully.
2013-10-31 16:11:59,992 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0016 has completed successfully.
2013-10-31 16:11:59,992 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0016,submitTime=1383235899852,launchTime=1383235899957,firstMapTaskLaunchTime=1383235907071,firstJobSetupTaskLaunchTime=1383235900945,firstJobCleanupTaskLaunchTime=1383235913980,finishTime=1383235919992,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=27,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[87C629D81DF64331889EA15A88EA787E/20861E5A5D2A45D58F9CD7EC15054E84] lhs*rhs/(1/1) ...ieldedpipesplatform/cross
2013-10-31 16:11:59,998 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5. blk_3560413497848393575_1182
2013-10-31 16:12:00,000 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560413497848393575_1182 src: /127.0.0.1:55016 dest: /127.0.0.1:41648
2013-10-31 16:12:00,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560413497848393575_1182 src: /127.0.0.1:48014 dest: /127.0.0.1:47311
2013-10-31 16:12:00,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560413497848393575_1182 src: /127.0.0.1:34982 dest: /127.0.0.1:38271
2013-10-31 16:12:00,007 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34982, dest: /127.0.0.1:38271, bytes: 22626, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3560413497848393575_1182, duration: 117596
2013-10-31 16:12:00,008 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3560413497848393575_1182 terminating
2013-10-31 16:12:00,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48014, dest: /127.0.0.1:47311, bytes: 22626, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3560413497848393575_1182, duration: 1018884
2013-10-31 16:12:00,009 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3560413497848393575_1182 terminating
2013-10-31 16:12:00,009 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55016, dest: /127.0.0.1:41648, bytes: 22626, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3560413497848393575_1182, duration: 2174543
2013-10-31 16:12:00,010 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3560413497848393575_1182 size 22626
2013-10-31 16:12:00,010 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3560413497848393575_1182 terminating
2013-10-31 16:12:00,016 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3560413497848393575_1182 size 22626
2013-10-31 16:12:00,016 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5 from client DFSClient_-1991226254
2013-10-31 16:12:00,017 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5 is closed by DFSClient_-1991226254
2013-10-31 16:12:00,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3560413497848393575_1182 size 22626
2013-10-31 16:12:00,025 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:12:00,026 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000003_0'
2013-10-31 16:12:00,026 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000004_0'
2013-10-31 16:12:00,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7194689012869079137 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:00,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7194689012869079137 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:00,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7194689012869079137 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:00,031 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0016_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:12:00,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016	dst=null	perm=null
2013-10-31 16:12:00,035 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary
2013-10-31 16:12:00,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross	dst=null	perm=null
2013-10-31 16:12:00,045 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 16:12:00,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2013-10-31 16:12:00,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2013-10-31 16:12:00,049 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2013-10-31 16:12:00,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2013-10-31 16:12:00,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2013-10-31 16:12:00,052 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34915, bytes: 100, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1338531806484752498_1178, duration: 138120
2013-10-31 16:12:00,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2013-10-31 16:12:00,055 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34916, bytes: 60, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3174711439536184192_1179, duration: 287977
2013-10-31 16:12:00,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2013-10-31 16:12:00,058 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55022, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6105123511850759531_1181, duration: 278563
2013-10-31 16:12:00,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2013-10-31 16:12:00,060 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48020, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4235132370181600024_1181, duration: 269643
2013-10-31 16:12:00,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross	dst=null	perm=null
2013-10-31 16:12:00,068 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 16:12:00,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2013-10-31 16:12:00,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2013-10-31 16:12:00,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2013-10-31 16:12:00,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2013-10-31 16:12:00,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2013-10-31 16:12:00,075 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34988, bytes: 100, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1338531806484752498_1178, duration: 265937
2013-10-31 16:12:00,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2013-10-31 16:12:00,077 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34920, bytes: 60, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3174711439536184192_1179, duration: 153687
2013-10-31 16:12:00,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2013-10-31 16:12:00,081 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55026, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6105123511850759531_1181, duration: 416712
2013-10-31 16:12:00,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2013-10-31 16:12:00,083 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55027, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4235132370181600024_1181, duration: 151348
2013-10-31 16:12:00,083 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/cross
2013-10-31 16:12:00,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross	dst=null	perm=null
2013-10-31 16:12:00,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2013-10-31 16:12:00,090 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34923, bytes: 100, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1338531806484752498_1178, duration: 144821
2013-10-31 16:12:00,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2013-10-31 16:12:00,093 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55029, bytes: 60, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3174711439536184192_1179, duration: 144454
2013-10-31 16:12:00,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2013-10-31 16:12:00,096 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55030, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6105123511850759531_1181, duration: 143922
2013-10-31 16:12:00,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2013-10-31 16:12:00,100 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34995, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4235132370181600024_1181, duration: 274731
2013-10-31 16:12:00,118 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:12:00,118 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:12:00,129 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:12:00,130 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:12:00,130 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:12:00,131 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join"]
2013-10-31 16:12:00,131 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:12:00,132 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:12:00,132 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:12:00,133 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...fieldedpipesplatform/join
2013-10-31 16:12:00,136 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:12:00,136 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:12:00,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:00,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:12:00,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:00,153 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar. blk_5312415671512961170_1183
2013-10-31 16:12:00,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5312415671512961170_1183 src: /127.0.0.1:48029 dest: /127.0.0.1:47311
2013-10-31 16:12:00,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5312415671512961170_1183 src: /127.0.0.1:55033 dest: /127.0.0.1:41648
2013-10-31 16:12:00,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5312415671512961170_1183 src: /127.0.0.1:34929 dest: /127.0.0.1:50942
2013-10-31 16:12:00,167 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34929, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5312415671512961170_1183, duration: 6523817
2013-10-31 16:12:00,168 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5312415671512961170_1183 terminating
2013-10-31 16:12:00,168 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55033, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5312415671512961170_1183, duration: 7343592
2013-10-31 16:12:00,169 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5312415671512961170_1183 size 238055
2013-10-31 16:12:00,169 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5312415671512961170_1183 terminating
2013-10-31 16:12:00,169 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48029, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5312415671512961170_1183, duration: 8372675
2013-10-31 16:12:00,169 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5312415671512961170_1183 size 238055
2013-10-31 16:12:00,170 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5312415671512961170_1183 terminating
2013-10-31 16:12:00,171 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5312415671512961170_1183 size 238055
2013-10-31 16:12:00,172 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar from client DFSClient_1457307213
2013-10-31 16:12:00,172 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar is closed by DFSClient_1457307213
2013-10-31 16:12:00,177 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar. New replication is 10
2013-10-31 16:12:00,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar	dst=null	perm=null
2013-10-31 16:12:00,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:00,186 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:12:00,191 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:00,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:00,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:00,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:00,206 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split. New replication is 10
2013-10-31 16:12:00,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split	dst=null	perm=null
2013-10-31 16:12:00,212 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split. blk_7955453648049656030_1184
2013-10-31 16:12:00,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7955453648049656030_1184 src: /127.0.0.1:55035 dest: /127.0.0.1:41648
2013-10-31 16:12:00,216 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7955453648049656030_1184 src: /127.0.0.1:35000 dest: /127.0.0.1:38271
2013-10-31 16:12:00,217 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7955453648049656030_1184 src: /127.0.0.1:48034 dest: /127.0.0.1:47311
2013-10-31 16:12:00,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7955453648049656030_1184 src: /127.0.0.1:34933 dest: /127.0.0.1:50942
2013-10-31 16:12:00,222 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34933, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7955453648049656030_1184, duration: 109289
2013-10-31 16:12:00,223 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7955453648049656030_1184 terminating
2013-10-31 16:12:00,223 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7955453648049656030_1184 size 1732
2013-10-31 16:12:00,223 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48034, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7955453648049656030_1184, duration: 1033050
2013-10-31 16:12:00,224 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7955453648049656030_1184 terminating
2013-10-31 16:12:00,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35000, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7955453648049656030_1184, duration: 2219818
2013-10-31 16:12:00,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7955453648049656030_1184 terminating
2013-10-31 16:12:00,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55035, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7955453648049656030_1184, duration: 3020165
2013-10-31 16:12:00,226 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7955453648049656030_1184 size 1732
2013-10-31 16:12:00,226 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7955453648049656030_1184 terminating
2013-10-31 16:12:00,227 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split from client DFSClient_1457307213
2013-10-31 16:12:00,228 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split is closed by DFSClient_1457307213
2013-10-31 16:12:00,228 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7955453648049656030_1184 size 1732
2013-10-31 16:12:00,229 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7955453648049656030_1184 size 1732
2013-10-31 16:12:00,241 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_5312415671512961170_1183 to datanode(s) 127.0.0.1:38271
2013-10-31 16:12:00,241 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_5829433608470320000_1174 blk_7194689012869079137_1177 blk_-1537610290047334833_1172 blk_-8699900213099915514_1171 blk_-8495043711673365996_1173
2013-10-31 16:12:00,241 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_7194689012869079137_1177
2013-10-31 16:12:00,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8699900213099915514_1171 file build/test/data/dfs/data/data4/current/blk_-8699900213099915514 for deletion
2013-10-31 16:12:00,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8495043711673365996_1173 file build/test/data/dfs/data/data4/current/blk_-8495043711673365996 for deletion
2013-10-31 16:12:00,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8699900213099915514_1171 at file build/test/data/dfs/data/data4/current/blk_-8699900213099915514
2013-10-31 16:12:00,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1537610290047334833_1172 file build/test/data/dfs/data/data3/current/blk_-1537610290047334833 for deletion
2013-10-31 16:12:00,369 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8495043711673365996_1173 at file build/test/data/dfs/data/data4/current/blk_-8495043711673365996
2013-10-31 16:12:00,369 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5829433608470320000_1174 file build/test/data/dfs/data/data3/current/blk_5829433608470320000 for deletion
2013-10-31 16:12:00,369 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1537610290047334833_1172 at file build/test/data/dfs/data/data3/current/blk_-1537610290047334833
2013-10-31 16:12:00,370 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7194689012869079137_1177 file build/test/data/dfs/data/data3/current/blk_7194689012869079137 for deletion
2013-10-31 16:12:00,370 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5829433608470320000_1174 at file build/test/data/dfs/data/data3/current/blk_5829433608470320000
2013-10-31 16:12:00,370 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7194689012869079137_1177 at file build/test/data/dfs/data/data3/current/blk_7194689012869079137
2013-10-31 16:12:02,089 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000000_0'
2013-10-31 16:12:02,090 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000005_0'
2013-10-31 16:12:02,843 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000001_0'
2013-10-31 16:12:02,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:02,953 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000002_0'
2013-10-31 16:12:02,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:02,961 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo. blk_8736535815943837723_1185
2013-10-31 16:12:02,963 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8736535815943837723_1185 src: /127.0.0.1:35004 dest: /127.0.0.1:38271
2013-10-31 16:12:02,964 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8736535815943837723_1185 src: /127.0.0.1:34936 dest: /127.0.0.1:50942
2013-10-31 16:12:02,965 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8736535815943837723_1185 src: /127.0.0.1:48039 dest: /127.0.0.1:47311
2013-10-31 16:12:02,967 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48039, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8736535815943837723_1185, duration: 705835
2013-10-31 16:12:02,968 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8736535815943837723_1185 terminating
2013-10-31 16:12:02,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34936, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8736535815943837723_1185, duration: 1058702
2013-10-31 16:12:02,968 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8736535815943837723_1185 terminating
2013-10-31 16:12:02,968 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8736535815943837723_1185 size 183
2013-10-31 16:12:02,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35004, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8736535815943837723_1185, duration: 988585
2013-10-31 16:12:02,969 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8736535815943837723_1185 terminating
2013-10-31 16:12:02,971 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8736535815943837723_1185 size 183
2013-10-31 16:12:02,971 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:12:02,971 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:12:02,972 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_5312415671512961170_1183 to 127.0.0.1:38271 
2013-10-31 16:12:02,972 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7194689012869079137_1177 file build/test/data/dfs/data/data8/current/blk_7194689012869079137 for deletion
2013-10-31 16:12:02,973 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7194689012869079137_1177 at file build/test/data/dfs/data/data8/current/blk_7194689012869079137
2013-10-31 16:12:02,973 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_5312415671512961170_1183 to /127.0.0.1:38271
2013-10-31 16:12:02,973 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8736535815943837723_1185 size 183
2013-10-31 16:12:02,973 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5312415671512961170_1183 src: /127.0.0.1:35007 dest: /127.0.0.1:38271
2013-10-31 16:12:02,976 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5312415671512961170_1183 src: /127.0.0.1:35007 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:12:02,978 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5312415671512961170_1183 size 238055
2013-10-31 16:12:02,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:02,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:02,994 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml. blk_-892002836518062520_1186
2013-10-31 16:12:02,996 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-892002836518062520_1186 src: /127.0.0.1:48041 dest: /127.0.0.1:47311
2013-10-31 16:12:02,997 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-892002836518062520_1186 src: /127.0.0.1:35009 dest: /127.0.0.1:38271
2013-10-31 16:12:02,998 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-892002836518062520_1186 src: /127.0.0.1:34941 dest: /127.0.0.1:50942
2013-10-31 16:12:03,000 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34941, dest: /127.0.0.1:50942, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-892002836518062520_1186, duration: 889215
2013-10-31 16:12:03,001 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-892002836518062520_1186 terminating
2013-10-31 16:12:03,001 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35009, dest: /127.0.0.1:38271, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-892002836518062520_1186, duration: 991385
2013-10-31 16:12:03,001 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-892002836518062520_1186 size 28289
2013-10-31 16:12:03,001 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-892002836518062520_1186 terminating
2013-10-31 16:12:03,001 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-892002836518062520_1186 size 28289
2013-10-31 16:12:03,001 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48041, dest: /127.0.0.1:47311, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-892002836518062520_1186, duration: 1086103
2013-10-31 16:12:03,002 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-892002836518062520_1186 size 28289
2013-10-31 16:12:03,002 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-892002836518062520_1186 terminating
2013-10-31 16:12:03,006 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml from client DFSClient_1457307213
2013-10-31 16:12:03,006 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml is closed by DFSClient_1457307213
2013-10-31 16:12:03,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml	dst=null	perm=null
2013-10-31 16:12:03,027 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48045, bytes: 28513, op: HDFS_READ, cliID: DFSClient_244823367, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-892002836518062520_1186, duration: 480971
2013-10-31 16:12:03,035 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0017: nMaps=5 nReduces=0 max=-1
2013-10-31 16:12:03,035 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0017 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:12:03,035 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0017	RESULT=SUCCESS
2013-10-31 16:12:03,035 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0017
2013-10-31 16:12:03,036 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0017
2013-10-31 16:12:03,037 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0017
2013-10-31 16:12:03,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:03,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:03,067 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_conf.xml. blk_-398564686101140297_1188
2013-10-31 16:12:03,070 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-398564686101140297_1188 src: /127.0.0.1:48046 dest: /127.0.0.1:47311
2013-10-31 16:12:03,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-398564686101140297_1188 src: /127.0.0.1:55050 dest: /127.0.0.1:41648
2013-10-31 16:12:03,073 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-398564686101140297_1188 src: /127.0.0.1:34946 dest: /127.0.0.1:50942
2013-10-31 16:12:03,076 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34946, dest: /127.0.0.1:50942, bytes: 28354, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-398564686101140297_1188, duration: 2031114
2013-10-31 16:12:03,076 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-398564686101140297_1188 terminating
2013-10-31 16:12:03,076 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55050, dest: /127.0.0.1:41648, bytes: 28354, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-398564686101140297_1188, duration: 1915793
2013-10-31 16:12:03,076 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-398564686101140297_1188 terminating
2013-10-31 16:12:03,076 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48046, dest: /127.0.0.1:47311, bytes: 28354, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-398564686101140297_1188, duration: 1659167
2013-10-31 16:12:03,077 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-398564686101140297_1188 terminating
2013-10-31 16:12:03,079 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-398564686101140297_1188 size 28354
2013-10-31 16:12:03,080 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-398564686101140297_1188 size 28354
2013-10-31 16:12:03,081 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-398564686101140297_1188 size 28354
2013-10-31 16:12:03,242 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_5829433608470320000_1174 blk_7194689012869079137_1177 blk_-1537610290047334833_1172 blk_-8699900213099915514_1171 blk_-8495043711673365996_1173
2013-10-31 16:12:03,481 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_conf.xml from client DFSClient_244823367
2013-10-31 16:12:03,481 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_conf.xml is closed by DFSClient_244823367
2013-10-31 16:12:03,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:03,498 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken. blk_-2321683491617084038_1189
2013-10-31 16:12:03,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2321683491617084038_1189 src: /127.0.0.1:35016 dest: /127.0.0.1:38271
2013-10-31 16:12:03,501 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2321683491617084038_1189 src: /127.0.0.1:55053 dest: /127.0.0.1:41648
2013-10-31 16:12:03,503 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2321683491617084038_1189 src: /127.0.0.1:48051 dest: /127.0.0.1:47311
2013-10-31 16:12:03,505 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48051, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2321683491617084038_1189, duration: 66329
2013-10-31 16:12:03,506 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2321683491617084038_1189 terminating
2013-10-31 16:12:03,506 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55053, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2321683491617084038_1189, duration: 878457
2013-10-31 16:12:03,507 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2321683491617084038_1189 terminating
2013-10-31 16:12:03,507 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35016, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2321683491617084038_1189, duration: 1971415
2013-10-31 16:12:03,508 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2321683491617084038_1189 size 116
2013-10-31 16:12:03,508 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2321683491617084038_1189 terminating
2013-10-31 16:12:03,510 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2321683491617084038_1189 size 116
2013-10-31 16:12:03,510 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken from client DFSClient_1457307213
2013-10-31 16:12:03,511 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken is closed by DFSClient_1457307213
2013-10-31 16:12:03,511 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2321683491617084038_1189 size 116
2013-10-31 16:12:03,518 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken
2013-10-31 16:12:03,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:12:03,522 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34950, bytes: 187, op: HDFS_READ, cliID: DFSClient_244823367, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8736535815943837723_1185, duration: 279061
2013-10-31 16:12:03,523 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0017 = 19. Number of splits = 5
2013-10-31 16:12:03,524 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,524 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,524 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,524 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,526 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,526 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,526 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,526 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,527 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,527 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,527 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0017 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:12:03,527 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0017 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:12:05,028 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0016
2013-10-31 16:12:05,028 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000003_0 not found in cache
2013-10-31 16:12:05,030 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000004_0 not found in cache
2013-10-31 16:12:05,031 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0016 for user-log deletion with retainTimeStamp:1383322325030
2013-10-31 16:12:05,094 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0017_m_000006_0' to tip task_20131031160444934_0017_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:05,100 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:12:05,100 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000006_0 which needs 1 slots
2013-10-31 16:12:05,101 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000006_0 which needs 1 slots
2013-10-31 16:12:05,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken	dst=null	perm=null
2013-10-31 16:12:05,109 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35020, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2321683491617084038_1189, duration: 301155
2013-10-31 16:12:05,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml	dst=null	perm=null
2013-10-31 16:12:05,120 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35022, bytes: 28513, op: HDFS_READ, cliID: DFSClient_325056449, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-892002836518062520_1186, duration: 387627
2013-10-31 16:12:05,148 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:05,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar	dst=null	perm=null
2013-10-31 16:12:05,182 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48056, bytes: 239915, op: HDFS_READ, cliID: DFSClient_325056449, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5312415671512961170_1183, duration: 1582669
2013-10-31 16:12:05,276 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0016_m_-768505707
2013-10-31 16:12:05,280 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19128 with signal TERM. Exit code 0
2013-10-31 16:12:05,281 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_1785081909
2013-10-31 16:12:05,281 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_1785081909 spawned.
2013-10-31 16:12:05,282 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000006_0/taskjvm.sh
2013-10-31 16:12:05,538 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_-383608023 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:05,546 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19301 with signal TERM. Exit code 0
2013-10-31 16:12:05,744 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:05,744 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:05,744 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:05,745 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_-383608023 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:05,769 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8699900213099915514_1171 file build/test/data/dfs/data/data1/current/blk_-8699900213099915514 for deletion
2013-10-31 16:12:05,769 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8495043711673365996_1173 file build/test/data/dfs/data/data1/current/blk_-8495043711673365996 for deletion
2013-10-31 16:12:05,770 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1537610290047334833_1172 file build/test/data/dfs/data/data2/current/blk_-1537610290047334833 for deletion
2013-10-31 16:12:05,770 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8699900213099915514_1171 at file build/test/data/dfs/data/data1/current/blk_-8699900213099915514
2013-10-31 16:12:05,770 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5829433608470320000_1174 file build/test/data/dfs/data/data2/current/blk_5829433608470320000 for deletion
2013-10-31 16:12:05,770 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8495043711673365996_1173 at file build/test/data/dfs/data/data1/current/blk_-8495043711673365996
2013-10-31 16:12:05,770 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7194689012869079137_1177 file build/test/data/dfs/data/data1/current/blk_7194689012869079137 for deletion
2013-10-31 16:12:05,770 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1537610290047334833_1172 at file build/test/data/dfs/data/data2/current/blk_-1537610290047334833
2013-10-31 16:12:05,770 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7194689012869079137_1177 at file build/test/data/dfs/data/data1/current/blk_7194689012869079137
2013-10-31 16:12:05,770 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5829433608470320000_1174 at file build/test/data/dfs/data/data2/current/blk_5829433608470320000
2013-10-31 16:12:05,803 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0016_m_-768505707
2013-10-31 16:12:06,416 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_-890241865 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:06,426 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19458 with signal TERM. Exit code 0
2013-10-31 16:12:06,595 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:06,595 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:06,595 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:06,595 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_-890241865 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:07,091 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0016
2013-10-31 16:12:07,091 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000000_0 not found in cache
2013-10-31 16:12:07,092 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0016 for user-log deletion with retainTimeStamp:1383322327092
2013-10-31 16:12:07,481 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:07,481 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:07,481 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:07,481 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_-768505707 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:07,493 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_2092185245 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:07,498 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19037 with signal TERM. Exit code 0
2013-10-31 16:12:07,655 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:07,655 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:07,655 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:07,655 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_2092185245 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:07,844 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0016
2013-10-31 16:12:07,844 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000001_0 not found in cache
2013-10-31 16:12:07,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0016 for user-log deletion with retainTimeStamp:1383322327844
2013-10-31 16:12:07,954 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0016
2013-10-31 16:12:07,954 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000002_0 not found in cache
2013-10-31 16:12:07,955 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0016 for user-log deletion with retainTimeStamp:1383322327955
2013-10-31 16:12:08,001 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 27
2013-10-31 16:12:08,035 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_-2031316218 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:08,044 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19223 with signal TERM. Exit code 0
2013-10-31 16:12:08,197 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_1785081909 given task: attempt_20131031160444934_0017_m_000006_0
2013-10-31 16:12:08,220 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:08,220 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:08,220 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:08,220 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_-2031316218 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:08,465 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_1360879598 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:08,469 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19258 with signal TERM. Exit code 0
2013-10-31 16:12:08,628 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:08,628 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:08,628 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:08,628 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_1360879598 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:08,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:11,638 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000006_0 0.0% setup
2013-10-31 16:12:11,640 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000006_0 is done.
2013-10-31 16:12:11,640 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000006_0  was -1
2013-10-31 16:12:11,641 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:14,108 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000006_0' has completed task_20131031160444934_0017_m_000006 successfully.
2013-10-31 16:12:14,113 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000000_0' to tip task_20131031160444934_0017_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:14,114 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000000
2013-10-31 16:12:14,115 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000001_0' to tip task_20131031160444934_0017_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:14,116 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000001
2013-10-31 16:12:14,118 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:12:14,118 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:12:14,119 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000000_0 which needs 1 slots
2013-10-31 16:12:14,119 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000000_0 which needs 1 slots
2013-10-31 16:12:14,119 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000001_0 which needs 1 slots
2013-10-31 16:12:14,120 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0017_m_000001_0 which needs 1 slots
2013-10-31 16:12:14,161 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_-1672180280
2013-10-31 16:12:14,161 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_-1672180280 spawned.
2013-10-31 16:12:14,162 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0017/attempt_20131031160444934_0017_m_000001_0. Attempting to reuse: jvm_20131031160444934_0017_m_1785081909
2013-10-31 16:12:14,163 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000000_0/taskjvm.sh
2013-10-31 16:12:14,859 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000002_0' to tip task_20131031160444934_0017_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:12:14,859 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000002
2013-10-31 16:12:14,859 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000003_0' to tip task_20131031160444934_0017_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:12:14,860 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000003
2013-10-31 16:12:14,862 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:12:14,863 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:12:14,863 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000002_0 which needs 1 slots
2013-10-31 16:12:14,863 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000002_0 which needs 1 slots
2013-10-31 16:12:14,863 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000003_0 which needs 1 slots
2013-10-31 16:12:14,863 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0017_m_000003_0 which needs 1 slots
2013-10-31 16:12:14,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken	dst=null	perm=null
2013-10-31 16:12:14,869 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35027, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2321683491617084038_1189, duration: 306896
2013-10-31 16:12:14,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml	dst=null	perm=null
2013-10-31 16:12:14,875 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48062, bytes: 28513, op: HDFS_READ, cliID: DFSClient_702944806, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-892002836518062520_1186, duration: 393685
2013-10-31 16:12:14,893 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:14,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar	dst=null	perm=null
2013-10-31 16:12:14,921 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35030, bytes: 239915, op: HDFS_READ, cliID: DFSClient_702944806, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5312415671512961170_1183, duration: 659251
2013-10-31 16:12:14,965 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000004_0' to tip task_20131031160444934_0017_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:12:14,965 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000004
2013-10-31 16:12:14,966 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:12:14,966 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000004_0 which needs 1 slots
2013-10-31 16:12:14,966 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000004_0 which needs 1 slots
2013-10-31 16:12:14,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken	dst=null	perm=null
2013-10-31 16:12:14,973 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48064, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2321683491617084038_1189, duration: 150083
2013-10-31 16:12:14,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml	dst=null	perm=null
2013-10-31 16:12:14,978 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48066, bytes: 28513, op: HDFS_READ, cliID: DFSClient_-223772127, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-892002836518062520_1186, duration: 163742
2013-10-31 16:12:14,986 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_-1717478233
2013-10-31 16:12:14,987 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_-1717478233 spawned.
2013-10-31 16:12:14,987 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_183874956
2013-10-31 16:12:14,988 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_183874956 spawned.
2013-10-31 16:12:14,989 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000003_0/taskjvm.sh
2013-10-31 16:12:14,989 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000002_0/taskjvm.sh
2013-10-31 16:12:14,990 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_-1672180280 given task: attempt_20131031160444934_0017_m_000000_0
2013-10-31 16:12:15,187 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_1785081909 given task: attempt_20131031160444934_0017_m_000001_0
2013-10-31 16:12:15,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split	dst=null	perm=null
2013-10-31 16:12:15,306 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48068, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7955453648049656030_1184, duration: 373288
2013-10-31 16:12:15,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:15,348 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35036, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 272844
2013-10-31 16:12:15,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:15,424 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:15,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:15,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar	dst=null	perm=null
2013-10-31 16:12:15,439 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35037, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-223772127, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5312415671512961170_1183, duration: 804143
2013-10-31 16:12:15,498 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_794190548
2013-10-31 16:12:15,499 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_794190548 spawned.
2013-10-31 16:12:15,501 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000004_0/taskjvm.sh
2013-10-31 16:12:15,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split	dst=null	perm=null
2013-10-31 16:12:15,775 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48072, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7955453648049656030_1184, duration: 479601
2013-10-31 16:12:15,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:15,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:15,804 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34971, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 146074
2013-10-31 16:12:15,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:15,813 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001. blk_5772099536953696869_1190
2013-10-31 16:12:15,828 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5772099536953696869_1190 src: /127.0.0.1:55077 dest: /127.0.0.1:41648
2013-10-31 16:12:15,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5772099536953696869_1190 src: /127.0.0.1:48075 dest: /127.0.0.1:47311
2013-10-31 16:12:15,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5772099536953696869_1190 src: /127.0.0.1:34974 dest: /127.0.0.1:50942
2013-10-31 16:12:15,832 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34974, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5772099536953696869_1190, duration: 1310786
2013-10-31 16:12:15,832 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5772099536953696869_1190 terminating
2013-10-31 16:12:15,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:15,832 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48075, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5772099536953696869_1190, duration: 1668707
2013-10-31 16:12:15,832 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5772099536953696869_1190 terminating
2013-10-31 16:12:15,833 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55077, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5772099536953696869_1190, duration: 2143111
2013-10-31 16:12:15,833 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5772099536953696869_1190 terminating
2013-10-31 16:12:15,836 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5772099536953696869_1190 size 8
2013-10-31 16:12:15,836 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0017_m_000001_0
2013-10-31 16:12:15,836 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0017_m_000001_0
2013-10-31 16:12:15,836 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5772099536953696869_1190 size 8
2013-10-31 16:12:15,836 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5772099536953696869_1190 size 8
2013-10-31 16:12:16,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:16,092 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:16,092 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000001_0 0.0% 
2013-10-31 16:12:16,209 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_-1717478233 given task: attempt_20131031160444934_0017_m_000003_0
2013-10-31 16:12:16,236 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_183874956 given task: attempt_20131031160444934_0017_m_000002_0
2013-10-31 16:12:16,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:16,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:16,275 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48079, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 147742
2013-10-31 16:12:16,278 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35047, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 102054
2013-10-31 16:12:16,285 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000. blk_-6404766974028651989_1191
2013-10-31 16:12:16,308 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6404766974028651989_1191 src: /127.0.0.1:48081 dest: /127.0.0.1:47311
2013-10-31 16:12:16,309 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6404766974028651989_1191 src: /127.0.0.1:55085 dest: /127.0.0.1:41648
2013-10-31 16:12:16,309 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6404766974028651989_1191 src: /127.0.0.1:34981 dest: /127.0.0.1:50942
2013-10-31 16:12:16,312 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34981, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6404766974028651989_1191, duration: 1042408
2013-10-31 16:12:16,312 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6404766974028651989_1191 terminating
2013-10-31 16:12:16,312 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6404766974028651989_1191 size 8
2013-10-31 16:12:16,312 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55085, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6404766974028651989_1191, duration: 1606992
2013-10-31 16:12:16,312 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6404766974028651989_1191 terminating
2013-10-31 16:12:16,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48081, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6404766974028651989_1191, duration: 2065604
2013-10-31 16:12:16,313 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6404766974028651989_1191 terminating
2013-10-31 16:12:16,314 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0017_m_000000_0
2013-10-31 16:12:16,314 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0017_m_000000_0
2013-10-31 16:12:16,314 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6404766974028651989_1191 size 8
2013-10-31 16:12:16,314 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6404766974028651989_1191 size 8
2013-10-31 16:12:16,363 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:16,364 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000000_0 0.0% 
2013-10-31 16:12:16,635 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_794190548 given task: attempt_20131031160444934_0017_m_000004_0
2013-10-31 16:12:16,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split	dst=null	perm=null
2013-10-31 16:12:16,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35054, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7955453648049656030_1184, duration: 164435
2013-10-31 16:12:16,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:16,752 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34986, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 134753
2013-10-31 16:12:16,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split	dst=null	perm=null
2013-10-31 16:12:16,762 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48089, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7955453648049656030_1184, duration: 158571
2013-10-31 16:12:16,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:16,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:16,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:16,802 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34988, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 128203
2013-10-31 16:12:16,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:16,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:16,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:16,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:16,983 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48091, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 138518
2013-10-31 16:12:16,992 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003. blk_-1127580485166157468_1193
2013-10-31 16:12:17,018 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1127580485166157468_1193 src: /127.0.0.1:55095 dest: /127.0.0.1:41648
2013-10-31 16:12:17,019 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1127580485166157468_1193 src: /127.0.0.1:34991 dest: /127.0.0.1:50942
2013-10-31 16:12:17,020 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1127580485166157468_1193 src: /127.0.0.1:35061 dest: /127.0.0.1:38271
2013-10-31 16:12:17,023 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35061, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1127580485166157468_1193, duration: 1112062
2013-10-31 16:12:17,023 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1127580485166157468_1193 terminating
2013-10-31 16:12:17,023 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34991, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1127580485166157468_1193, duration: 1498304
2013-10-31 16:12:17,024 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1127580485166157468_1193 terminating
2013-10-31 16:12:17,024 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55095, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1127580485166157468_1193, duration: 1927846
2013-10-31 16:12:17,024 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1127580485166157468_1193 terminating
2013-10-31 16:12:17,027 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1127580485166157468_1193 size 8
2013-10-31 16:12:17,027 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1127580485166157468_1193 size 8
2013-10-31 16:12:17,028 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1127580485166157468_1193 size 8
2013-10-31 16:12:17,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:17,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:17,067 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48096, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 126447
2013-10-31 16:12:17,076 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002. blk_-2831952084742760834_1193
2013-10-31 16:12:17,102 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2831952084742760834_1193 src: /127.0.0.1:48097 dest: /127.0.0.1:47311
2013-10-31 16:12:17,103 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2831952084742760834_1193 src: /127.0.0.1:35065 dest: /127.0.0.1:38271
2013-10-31 16:12:17,103 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2831952084742760834_1193 src: /127.0.0.1:34997 dest: /127.0.0.1:50942
2013-10-31 16:12:17,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34997, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2831952084742760834_1193, duration: 1004030
2013-10-31 16:12:17,106 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2831952084742760834_1193 terminating
2013-10-31 16:12:17,106 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2831952084742760834_1193 size 8
2013-10-31 16:12:17,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35065, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2831952084742760834_1193, duration: 1334672
2013-10-31 16:12:17,106 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2831952084742760834_1193 terminating
2013-10-31 16:12:17,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48097, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2831952084742760834_1193, duration: 1812118
2013-10-31 16:12:17,106 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2831952084742760834_1193 terminating
2013-10-31 16:12:17,107 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0017_m_000002_0
2013-10-31 16:12:17,107 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0017_m_000002_0
2013-10-31 16:12:17,109 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2831952084742760834_1193 size 8
2013-10-31 16:12:17,111 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2831952084742760834_1193 size 8
2013-10-31 16:12:17,120 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000000_0
2013-10-31 16:12:17,120 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000001_0
2013-10-31 16:12:17,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split	dst=null	perm=null
2013-10-31 16:12:17,136 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35067, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7955453648049656030_1184, duration: 155596
2013-10-31 16:12:17,159 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:17,159 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000002_0 0.0% 
2013-10-31 16:12:17,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:17,175 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48101, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 121534
2013-10-31 16:12:17,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:17,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:17,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0	dst=null	perm=null
2013-10-31 16:12:17,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:17,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:17,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0	dst=null	perm=null
2013-10-31 16:12:17,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:17,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:17,408 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48102, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 106943
2013-10-31 16:12:17,417 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004. blk_2135090211933811428_1194
2013-10-31 16:12:17,426 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0017_m_000003_0
2013-10-31 16:12:17,427 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0017_m_000003_0
2013-10-31 16:12:17,441 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2135090211933811428_1194 src: /127.0.0.1:55106 dest: /127.0.0.1:41648
2013-10-31 16:12:17,444 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2135090211933811428_1194 src: /127.0.0.1:35002 dest: /127.0.0.1:50942
2013-10-31 16:12:17,444 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2135090211933811428_1194 src: /127.0.0.1:48105 dest: /127.0.0.1:47311
2013-10-31 16:12:17,447 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48105, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2135090211933811428_1194, duration: 1497655
2013-10-31 16:12:17,447 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2135090211933811428_1194 terminating
2013-10-31 16:12:17,447 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35002, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2135090211933811428_1194, duration: 1850003
2013-10-31 16:12:17,447 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2135090211933811428_1194 terminating
2013-10-31 16:12:17,448 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55106, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2135090211933811428_1194, duration: 1948958
2013-10-31 16:12:17,448 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2135090211933811428_1194 terminating
2013-10-31 16:12:17,449 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2135090211933811428_1194 size 8
2013-10-31 16:12:17,449 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2135090211933811428_1194 size 8
2013-10-31 16:12:17,450 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2135090211933811428_1194 size 8
2013-10-31 16:12:17,487 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:17,487 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000003_0 0.0% 
2013-10-31 16:12:17,850 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0017_m_000004_0
2013-10-31 16:12:17,850 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0017_m_000004_0
2013-10-31 16:12:17,868 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000002_0
2013-10-31 16:12:17,868 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000003_0
2013-10-31 16:12:17,919 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:17,919 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000004_0 0.0% 
2013-10-31 16:12:17,969 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000004_0
2013-10-31 16:12:18,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0	dst=null	perm=null
2013-10-31 16:12:18,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:18,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0	dst=null	perm=null
2013-10-31 16:12:18,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:18,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0	dst=null	perm=null
2013-10-31 16:12:18,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:18,700 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:12:18,702 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000000_0 is done.
2013-10-31 16:12:18,702 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000000_0  was -1
2013-10-31 16:12:18,702 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:18,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0	dst=null	perm=null
2013-10-31 16:12:18,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:19,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:19,119 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0017_m_000006_0
2013-10-31 16:12:19,119 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0017_m_000006_0
2013-10-31 16:12:19,120 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000006_0 not found in cache
2013-10-31 16:12:20,124 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000000_0' has completed task_20131031160444934_0017_m_000000 successfully.
2013-10-31 16:12:20,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:20,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:20,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:20,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0	dst=null	perm=null
2013-10-31 16:12:20,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0	dst=null	perm=null
2013-10-31 16:12:20,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0	dst=null	perm=null
2013-10-31 16:12:20,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0	dst=null	perm=null
2013-10-31 16:12:21,295 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:12:21,297 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:12:21,298 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000001_0 is done.
2013-10-31 16:12:21,298 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000001_0  was -1
2013-10-31 16:12:21,298 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:22,681 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:12:22,683 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:12:22,684 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000003_0 is done.
2013-10-31 16:12:22,684 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000003_0  was -1
2013-10-31 16:12:22,684 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:22,736 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:12:22,739 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:12:22,740 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000002_0 is done.
2013-10-31 16:12:22,741 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000002_0  was -1
2013-10-31 16:12:22,741 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:23,115 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:12:23,117 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:12:23,119 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000004_0 is done.
2013-10-31 16:12:23,119 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000004_0  was -1
2013-10-31 16:12:23,119 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:23,130 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000001_0' has completed task_20131031160444934_0017_m_000001 successfully.
2013-10-31 16:12:23,875 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000002_0' has completed task_20131031160444934_0017_m_000002 successfully.
2013-10-31 16:12:23,877 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000003_0' has completed task_20131031160444934_0017_m_000003 successfully.
2013-10-31 16:12:23,976 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000004_0' has completed task_20131031160444934_0017_m_000004 successfully.
2013-10-31 16:12:23,980 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0017_m_000005_0' to tip task_20131031160444934_0017_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:12:23,982 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:12:23,983 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000005_0 which needs 1 slots
2013-10-31 16:12:23,983 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000005_0 which needs 1 slots
2013-10-31 16:12:24,019 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_1249937429
2013-10-31 16:12:24,020 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_1249937429 spawned.
2013-10-31 16:12:24,022 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000005_0/taskjvm.sh
2013-10-31 16:12:24,893 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_1249937429 given task: attempt_20131031160444934_0017_m_000005_0
2013-10-31 16:12:25,423 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000005_0 0.0% 
2013-10-31 16:12:25,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary	dst=null	perm=null
2013-10-31 16:12:25,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:25,448 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_SUCCESS from client DFSClient_attempt_20131031160444934_0017_m_000005_0
2013-10-31 16:12:25,448 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0017_m_000005_0
2013-10-31 16:12:25,463 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5312415671512961170 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:25,463 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5312415671512961170 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:25,463 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5312415671512961170 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:25,464 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5312415671512961170 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:25,464 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7955453648049656030 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:25,464 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7955453648049656030 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:25,464 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7955453648049656030 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:25,464 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7955453648049656030 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:25,465 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8736535815943837723 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:25,465 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8736535815943837723 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:25,465 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8736535815943837723 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:25,465 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-892002836518062520 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:25,466 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-892002836518062520 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:25,466 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-892002836518062520 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:25,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017	dst=null	perm=null
2013-10-31 16:12:27,246 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_5312415671512961170_1183 blk_7955453648049656030_1184
2013-10-31 16:12:27,246 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_8736535815943837723_1185 blk_-892002836518062520_1186 blk_5312415671512961170_1183 blk_7955453648049656030_1184
2013-10-31 16:12:27,377 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-892002836518062520_1186 file build/test/data/dfs/data/data4/current/blk_-892002836518062520 for deletion
2013-10-31 16:12:27,377 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5312415671512961170_1183 file build/test/data/dfs/data/data3/current/blk_5312415671512961170 for deletion
2013-10-31 16:12:27,377 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-892002836518062520_1186 at file build/test/data/dfs/data/data4/current/blk_-892002836518062520
2013-10-31 16:12:27,378 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7955453648049656030_1184 file build/test/data/dfs/data/data4/current/blk_7955453648049656030 for deletion
2013-10-31 16:12:27,378 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5312415671512961170_1183 at file build/test/data/dfs/data/data3/current/blk_5312415671512961170
2013-10-31 16:12:27,378 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7955453648049656030_1184 at file build/test/data/dfs/data/data4/current/blk_7955453648049656030
2013-10-31 16:12:27,378 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8736535815943837723_1185 file build/test/data/dfs/data/data3/current/blk_8736535815943837723 for deletion
2013-10-31 16:12:27,379 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8736535815943837723_1185 at file build/test/data/dfs/data/data3/current/blk_8736535815943837723
2013-10-31 16:12:27,990 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5312415671512961170_1183 file build/test/data/dfs/data/data6/current/blk_5312415671512961170 for deletion
2013-10-31 16:12:27,990 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7955453648049656030_1184 file build/test/data/dfs/data/data5/current/blk_7955453648049656030 for deletion
2013-10-31 16:12:27,990 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5312415671512961170_1183 at file build/test/data/dfs/data/data6/current/blk_5312415671512961170
2013-10-31 16:12:27,991 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7955453648049656030_1184 at file build/test/data/dfs/data/data5/current/blk_7955453648049656030
2013-10-31 16:12:28,334 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000005_0 0.0% cleanup
2013-10-31 16:12:28,335 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000005_0 is done.
2013-10-31 16:12:28,335 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000005_0  was -1
2013-10-31 16:12:28,336 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:29,989 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000005_0' has completed task_20131031160444934_0017_m_000005 successfully.
2013-10-31 16:12:29,990 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0017 has completed successfully.
2013-10-31 16:12:29,991 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0017,submitTime=1383235923014,launchTime=1383235923527,firstMapTaskLaunchTime=1383235934113,firstJobSetupTaskLaunchTime=1383235925094,firstJobCleanupTaskLaunchTime=1383235943980,finishTime=1383235949990,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[171DBA39EB4D40BF8F96A53B473D2ADE/61C7BBC3CEEB4416B2B8245E31D89539] lower*upper/(1/1) ...fieldedpipesplatform/join
2013-10-31 16:12:29,997 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416. blk_-6815815763095842592_1195
2013-10-31 16:12:30,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6815815763095842592_1195 src: /127.0.0.1:55113 dest: /127.0.0.1:41648
2013-10-31 16:12:30,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6815815763095842592_1195 src: /127.0.0.1:35009 dest: /127.0.0.1:50942
2013-10-31 16:12:30,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6815815763095842592_1195 src: /127.0.0.1:35079 dest: /127.0.0.1:38271
2013-10-31 16:12:30,017 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35079, dest: /127.0.0.1:38271, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6815815763095842592_1195, duration: 3313958
2013-10-31 16:12:30,018 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6815815763095842592_1195 terminating
2013-10-31 16:12:30,019 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35009, dest: /127.0.0.1:50942, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6815815763095842592_1195, duration: 4210689
2013-10-31 16:12:30,019 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6815815763095842592_1195 terminating
2013-10-31 16:12:30,019 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55113, dest: /127.0.0.1:41648, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6815815763095842592_1195, duration: 5478881
2013-10-31 16:12:30,020 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6815815763095842592_1195 terminating
2013-10-31 16:12:30,021 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6815815763095842592_1195 size 26341
2013-10-31 16:12:30,025 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416 from client DFSClient_244823367
2013-10-31 16:12:30,025 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416 is closed by DFSClient_244823367
2013-10-31 16:12:30,026 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6815815763095842592_1195 size 26341
2013-10-31 16:12:30,026 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6815815763095842592_1195 size 26341
2013-10-31 16:12:30,032 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:12:30,033 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000004_0'
2013-10-31 16:12:30,033 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000005_0'
2013-10-31 16:12:30,035 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2321683491617084038 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:30,035 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2321683491617084038 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:30,035 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2321683491617084038 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:30,038 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0017_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:12:30,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017	dst=null	perm=null
2013-10-31 16:12:30,041 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary
2013-10-31 16:12:30,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join	dst=null	perm=null
2013-10-31 16:12:30,051 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:12:30,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2013-10-31 16:12:30,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2013-10-31 16:12:30,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2013-10-31 16:12:30,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2013-10-31 16:12:30,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2013-10-31 16:12:30,056 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0017
2013-10-31 16:12:30,057 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0017 being deleted.
2013-10-31 16:12:30,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2013-10-31 16:12:30,059 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48114, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6404766974028651989_1191, duration: 289791
2013-10-31 16:12:30,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2013-10-31 16:12:30,061 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48115, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5772099536953696869_1190, duration: 139707
2013-10-31 16:12:30,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2013-10-31 16:12:30,064 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35014, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2831952084742760834_1193, duration: 271988
2013-10-31 16:12:30,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2013-10-31 16:12:30,065 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35015, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1127580485166157468_1193, duration: 119168
2013-10-31 16:12:30,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2013-10-31 16:12:30,067 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55121, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2135090211933811428_1194, duration: 116541
2013-10-31 16:12:30,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join	dst=null	perm=null
2013-10-31 16:12:30,076 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:12:30,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2013-10-31 16:12:30,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2013-10-31 16:12:30,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2013-10-31 16:12:30,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2013-10-31 16:12:30,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2013-10-31 16:12:30,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2013-10-31 16:12:30,083 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55122, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6404766974028651989_1191, duration: 283185
2013-10-31 16:12:30,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2013-10-31 16:12:30,086 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55123, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5772099536953696869_1190, duration: 268717
2013-10-31 16:12:30,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2013-10-31 16:12:30,088 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35019, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2831952084742760834_1193, duration: 264754
2013-10-31 16:12:30,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2013-10-31 16:12:30,090 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35089, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1127580485166157468_1193, duration: 268841
2013-10-31 16:12:30,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2013-10-31 16:12:30,093 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35021, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2135090211933811428_1194, duration: 271045
2013-10-31 16:12:30,093 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/join
2013-10-31 16:12:30,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join	dst=null	perm=null
2013-10-31 16:12:30,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2013-10-31 16:12:30,099 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35022, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6404766974028651989_1191, duration: 268781
2013-10-31 16:12:30,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2013-10-31 16:12:30,102 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55128, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5772099536953696869_1190, duration: 268776
2013-10-31 16:12:30,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2013-10-31 16:12:30,105 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35024, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2831952084742760834_1193, duration: 132146
2013-10-31 16:12:30,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2013-10-31 16:12:30,108 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55130, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1127580485166157468_1193, duration: 116274
2013-10-31 16:12:30,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2013-10-31 16:12:30,111 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55131, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2135090211933811428_1194, duration: 111045
2013-10-31 16:12:30,122 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:12:30,122 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:12:30,141 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] starting
2013-10-31 16:12:30,141 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:12:30,142 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:12:30,142 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:12:30,142 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:12:30,143 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby"]
2013-10-31 16:12:30,143 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging]  parallel execution is enabled: true
2013-10-31 16:12:30,143 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging]  starting jobs: 1
2013-10-31 16:12:30,143 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merging]  allocating threads: 1
2013-10-31 16:12:30,144 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merging] starting step: (1/1) ...platform/joinsintogroupby
2013-10-31 16:12:30,148 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:12:30,148 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:12:30,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:30,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:12:30,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:30,174 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar. blk_-1059958856430979839_1196
2013-10-31 16:12:30,175 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059958856430979839_1196 src: /127.0.0.1:55132 dest: /127.0.0.1:41648
2013-10-31 16:12:30,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059958856430979839_1196 src: /127.0.0.1:48130 dest: /127.0.0.1:47311
2013-10-31 16:12:30,178 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059958856430979839_1196 src: /127.0.0.1:35029 dest: /127.0.0.1:50942
2013-10-31 16:12:30,182 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35029, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1059958856430979839_1196, duration: 3352851
2013-10-31 16:12:30,182 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1059958856430979839_1196 terminating
2013-10-31 16:12:30,182 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48130, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1059958856430979839_1196, duration: 2546406
2013-10-31 16:12:30,182 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1059958856430979839_1196 terminating
2013-10-31 16:12:30,182 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55132, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1059958856430979839_1196, duration: 3362030
2013-10-31 16:12:30,183 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1059958856430979839_1196 terminating
2013-10-31 16:12:30,185 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1059958856430979839_1196 size 238055
2013-10-31 16:12:30,186 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1059958856430979839_1196 size 238055
2013-10-31 16:12:30,187 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1059958856430979839_1196 size 238055
2013-10-31 16:12:30,247 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_8736535815943837723_1185 blk_-2321683491617084038_1189 blk_-892002836518062520_1186 blk_5312415671512961170_1183 blk_7955453648049656030_1184
2013-10-31 16:12:30,247 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-2321683491617084038_1189
2013-10-31 16:12:30,378 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2321683491617084038_1189 file build/test/data/dfs/data/data4/current/blk_-2321683491617084038 for deletion
2013-10-31 16:12:30,378 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2321683491617084038_1189 at file build/test/data/dfs/data/data4/current/blk_-2321683491617084038
2013-10-31 16:12:30,585 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar from client DFSClient_1457307213
2013-10-31 16:12:30,585 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar is closed by DFSClient_1457307213
2013-10-31 16:12:30,593 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar. New replication is 10
2013-10-31 16:12:30,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar	dst=null	perm=null
2013-10-31 16:12:30,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:30,606 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:12:30,611 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:30,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:30,614 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:30,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:12:30,617 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:30,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:30,620 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:30,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:12:31,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,069 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split. New replication is 10
2013-10-31 16:12:31,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=null
2013-10-31 16:12:31,077 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split. blk_7127854054404477716_1197
2013-10-31 16:12:31,078 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127854054404477716_1197 src: /127.0.0.1:48133 dest: /127.0.0.1:47311
2013-10-31 16:12:31,079 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127854054404477716_1197 src: /127.0.0.1:55137 dest: /127.0.0.1:41648
2013-10-31 16:12:31,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127854054404477716_1197 src: /127.0.0.1:35102 dest: /127.0.0.1:38271
2013-10-31 16:12:31,083 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127854054404477716_1197 src: /127.0.0.1:35034 dest: /127.0.0.1:50942
2013-10-31 16:12:31,089 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35034, dest: /127.0.0.1:50942, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7127854054404477716_1197, duration: 3583645
2013-10-31 16:12:31,089 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7127854054404477716_1197 terminating
2013-10-31 16:12:31,090 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35102, dest: /127.0.0.1:38271, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7127854054404477716_1197, duration: 381167
2013-10-31 16:12:31,090 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7127854054404477716_1197 terminating
2013-10-31 16:12:31,091 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55137, dest: /127.0.0.1:41648, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7127854054404477716_1197, duration: 1189377
2013-10-31 16:12:31,091 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7127854054404477716_1197 size 2073
2013-10-31 16:12:31,091 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7127854054404477716_1197 terminating
2013-10-31 16:12:31,091 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48133, dest: /127.0.0.1:47311, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7127854054404477716_1197, duration: 2067294
2013-10-31 16:12:31,092 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7127854054404477716_1197 terminating
2013-10-31 16:12:31,100 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7127854054404477716_1197 size 2073
2013-10-31 16:12:31,100 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split from client DFSClient_1457307213
2013-10-31 16:12:31,100 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split is closed by DFSClient_1457307213
2013-10-31 16:12:31,100 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7127854054404477716_1197 size 2073
2013-10-31 16:12:31,100 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7127854054404477716_1197 size 2073
2013-10-31 16:12:31,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,119 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo. blk_-2560831434870646292_1198
2013-10-31 16:12:31,120 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2560831434870646292_1198 src: /127.0.0.1:55140 dest: /127.0.0.1:41648
2013-10-31 16:12:31,121 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2560831434870646292_1198 src: /127.0.0.1:48138 dest: /127.0.0.1:47311
2013-10-31 16:12:31,122 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2560831434870646292_1198 src: /127.0.0.1:35106 dest: /127.0.0.1:38271
2013-10-31 16:12:31,125 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35106, dest: /127.0.0.1:38271, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2560831434870646292_1198, duration: 832245
2013-10-31 16:12:31,125 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2560831434870646292_1198 terminating
2013-10-31 16:12:31,125 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48138, dest: /127.0.0.1:47311, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2560831434870646292_1198, duration: 612954
2013-10-31 16:12:31,125 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2560831434870646292_1198 size 218
2013-10-31 16:12:31,125 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2560831434870646292_1198 terminating
2013-10-31 16:12:31,125 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55140, dest: /127.0.0.1:41648, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2560831434870646292_1198, duration: 983368
2013-10-31 16:12:31,125 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2560831434870646292_1198 size 218
2013-10-31 16:12:31,126 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2560831434870646292_1198 terminating
2013-10-31 16:12:31,127 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2560831434870646292_1198 size 218
2013-10-31 16:12:31,127 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:12:31,127 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:12:31,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,147 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml. blk_3022094558686490251_1199
2013-10-31 16:12:31,148 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3022094558686490251_1199 src: /127.0.0.1:35038 dest: /127.0.0.1:50942
2013-10-31 16:12:31,152 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3022094558686490251_1199 src: /127.0.0.1:55144 dest: /127.0.0.1:41648
2013-10-31 16:12:31,153 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3022094558686490251_1199 src: /127.0.0.1:35109 dest: /127.0.0.1:38271
2013-10-31 16:12:31,155 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35109, dest: /127.0.0.1:38271, bytes: 29924, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3022094558686490251_1199, duration: 127455
2013-10-31 16:12:31,155 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3022094558686490251_1199 terminating
2013-10-31 16:12:31,155 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3022094558686490251_1199 size 29924
2013-10-31 16:12:31,156 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55144, dest: /127.0.0.1:41648, bytes: 29924, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3022094558686490251_1199, duration: 539060
2013-10-31 16:12:31,156 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3022094558686490251_1199 terminating
2013-10-31 16:12:31,156 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35038, dest: /127.0.0.1:50942, bytes: 29924, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3022094558686490251_1199, duration: 1419247
2013-10-31 16:12:31,157 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3022094558686490251_1199 terminating
2013-10-31 16:12:31,158 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3022094558686490251_1199 size 29924
2013-10-31 16:12:31,159 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml from client DFSClient_1457307213
2013-10-31 16:12:31,159 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml is closed by DFSClient_1457307213
2013-10-31 16:12:31,160 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3022094558686490251_1199 size 29924
2013-10-31 16:12:31,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml	dst=null	perm=null
2013-10-31 16:12:31,174 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55147, bytes: 30160, op: HDFS_READ, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3022094558686490251_1199, duration: 179181
2013-10-31 16:12:31,196 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0018: nMaps=6 nReduces=1 max=-1
2013-10-31 16:12:31,197 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0018 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:12:31,197 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0018
2013-10-31 16:12:31,197 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0018	RESULT=SUCCESS
2013-10-31 16:12:31,197 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0018
2013-10-31 16:12:31,198 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merging] submitted hadoop job: job_20131031160444934_0018
2013-10-31 16:12:31,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,216 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_conf.xml. blk_-6606841141478771094_1201
2013-10-31 16:12:31,217 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6606841141478771094_1201 src: /127.0.0.1:35043 dest: /127.0.0.1:50942
2013-10-31 16:12:31,217 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6606841141478771094_1201 src: /127.0.0.1:48146 dest: /127.0.0.1:47311
2013-10-31 16:12:31,218 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6606841141478771094_1201 src: /127.0.0.1:55150 dest: /127.0.0.1:41648
2013-10-31 16:12:31,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55150, dest: /127.0.0.1:41648, bytes: 29989, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6606841141478771094_1201, duration: 85082
2013-10-31 16:12:31,221 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6606841141478771094_1201 terminating
2013-10-31 16:12:31,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48146, dest: /127.0.0.1:47311, bytes: 29989, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6606841141478771094_1201, duration: 900038
2013-10-31 16:12:31,222 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6606841141478771094_1201 size 29989
2013-10-31 16:12:31,222 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6606841141478771094_1201 terminating
2013-10-31 16:12:31,222 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35043, dest: /127.0.0.1:50942, bytes: 29989, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6606841141478771094_1201, duration: 1872395
2013-10-31 16:12:31,223 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6606841141478771094_1201 terminating
2013-10-31 16:12:31,224 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_conf.xml from client DFSClient_-1577091776
2013-10-31 16:12:31,224 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_conf.xml is closed by DFSClient_-1577091776
2013-10-31 16:12:31,225 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6606841141478771094_1201 size 29989
2013-10-31 16:12:31,226 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6606841141478771094_1201 size 29989
2013-10-31 16:12:31,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,234 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken. blk_8179163193991924216_1202
2013-10-31 16:12:31,235 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8179163193991924216_1202 src: /127.0.0.1:35115 dest: /127.0.0.1:38271
2013-10-31 16:12:31,236 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8179163193991924216_1202 src: /127.0.0.1:55152 dest: /127.0.0.1:41648
2013-10-31 16:12:31,237 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8179163193991924216_1202 src: /127.0.0.1:48150 dest: /127.0.0.1:47311
2013-10-31 16:12:31,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48150, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8179163193991924216_1202, duration: 449258
2013-10-31 16:12:31,241 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8179163193991924216_1202 terminating
2013-10-31 16:12:31,241 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55152, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8179163193991924216_1202, duration: 1238176
2013-10-31 16:12:31,242 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8179163193991924216_1202 terminating
2013-10-31 16:12:31,242 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35115, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8179163193991924216_1202, duration: 2072509
2013-10-31 16:12:31,243 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8179163193991924216_1202 terminating
2013-10-31 16:12:31,245 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8179163193991924216_1202 size 116
2013-10-31 16:12:31,245 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken from client DFSClient_1457307213
2013-10-31 16:12:31,246 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken is closed by DFSClient_1457307213
2013-10-31 16:12:31,246 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8179163193991924216_1202 size 116
2013-10-31 16:12:31,247 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8179163193991924216_1202 size 116
2013-10-31 16:12:31,252 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken
2013-10-31 16:12:31,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:12:31,256 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48151, bytes: 222, op: HDFS_READ, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2560831434870646292_1198, duration: 271459
2013-10-31 16:12:31,258 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0018 = 71. Number of splits = 6
2013-10-31 16:12:31,258 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,259 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,259 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,259 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,259 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,260 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,260 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,260 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,260 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,262 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,262 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,262 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,262 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,263 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0018 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:12:31,263 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0018 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 16:12:32,144 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0018_m_000007_0' to tip task_20131031160444934_0018_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:32,150 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000000_0'
2013-10-31 16:12:32,150 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000001_0'
2013-10-31 16:12:32,150 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000006_0'
2013-10-31 16:12:32,152 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000007_0 task's state:UNASSIGNED
2013-10-31 16:12:32,152 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000007_0 which needs 1 slots
2013-10-31 16:12:32,152 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000007_0 which needs 1 slots
2013-10-31 16:12:32,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken	dst=null	perm=null
2013-10-31 16:12:32,160 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48152, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8179163193991924216_1202, duration: 273240
2013-10-31 16:12:32,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml	dst=null	perm=null
2013-10-31 16:12:32,171 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35052, bytes: 30160, op: HDFS_READ, cliID: DFSClient_531802620, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3022094558686490251_1199, duration: 383154
2013-10-31 16:12:32,203 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:32,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar	dst=null	perm=null
2013-10-31 16:12:32,231 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48155, bytes: 239915, op: HDFS_READ, cliID: DFSClient_531802620, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1059958856430979839_1196, duration: 1110718
2013-10-31 16:12:32,341 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0017_m_1785081909
2013-10-31 16:12:32,348 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19654 with signal TERM. Exit code 0
2013-10-31 16:12:32,348 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_630055656
2013-10-31 16:12:32,349 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_630055656 spawned.
2013-10-31 16:12:32,351 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000007_0/taskjvm.sh
2013-10-31 16:12:32,779 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2321683491617084038_1189 file build/test/data/dfs/data/data1/current/blk_-2321683491617084038 for deletion
2013-10-31 16:12:32,779 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-892002836518062520_1186 file build/test/data/dfs/data/data2/current/blk_-892002836518062520 for deletion
2013-10-31 16:12:32,779 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2321683491617084038_1189 at file build/test/data/dfs/data/data1/current/blk_-2321683491617084038
2013-10-31 16:12:32,779 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5312415671512961170_1183 file build/test/data/dfs/data/data1/current/blk_5312415671512961170 for deletion
2013-10-31 16:12:32,780 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-892002836518062520_1186 at file build/test/data/dfs/data/data2/current/blk_-892002836518062520
2013-10-31 16:12:32,780 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7955453648049656030_1184 file build/test/data/dfs/data/data1/current/blk_7955453648049656030 for deletion
2013-10-31 16:12:32,780 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5312415671512961170_1183 at file build/test/data/dfs/data/data1/current/blk_5312415671512961170
2013-10-31 16:12:32,780 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8736535815943837723_1185 file build/test/data/dfs/data/data2/current/blk_8736535815943837723 for deletion
2013-10-31 16:12:32,781 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7955453648049656030_1184 at file build/test/data/dfs/data/data1/current/blk_7955453648049656030
2013-10-31 16:12:32,781 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8736535815943837723_1185 at file build/test/data/dfs/data/data2/current/blk_8736535815943837723
2013-10-31 16:12:32,888 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000002_0'
2013-10-31 16:12:32,888 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000003_0'
2013-10-31 16:12:33,203 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:33,203 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:33,203 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:33,203 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_1785081909 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:12:33,248 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-1059958856430979839_1196 to datanode(s) 127.0.0.1:38271
2013-10-31 16:12:33,248 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-2321683491617084038_1189
2013-10-31 16:12:33,249 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_8736535815943837723_1185 blk_-892002836518062520_1186 blk_5312415671512961170_1183 blk_7955453648049656030_1184
2013-10-31 16:12:33,991 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2321683491617084038_1189 file build/test/data/dfs/data/data5/current/blk_-2321683491617084038 for deletion
2013-10-31 16:12:33,992 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2321683491617084038_1189 at file build/test/data/dfs/data/data5/current/blk_-2321683491617084038
2013-10-31 16:12:34,088 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_630055656 given task: attempt_20131031160444934_0018_m_000007_0
2013-10-31 16:12:34,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:35,035 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0017
2013-10-31 16:12:35,036 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000005_0 not found in cache
2013-10-31 16:12:35,036 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000004_0 not found in cache
2013-10-31 16:12:35,037 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0017 for user-log deletion with retainTimeStamp:1383322355037
2013-10-31 16:12:35,692 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_794190548 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:35,702 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19950 with signal TERM. Exit code 0
2013-10-31 16:12:35,875 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:35,875 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:35,875 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:35,875 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_794190548 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:35,983 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-1059958856430979839_1196 to 127.0.0.1:38271 
2013-10-31 16:12:35,983 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-892002836518062520_1186 file build/test/data/dfs/data/data7/current/blk_-892002836518062520 for deletion
2013-10-31 16:12:35,984 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5312415671512961170_1183 file build/test/data/dfs/data/data8/current/blk_5312415671512961170 for deletion
2013-10-31 16:12:35,984 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-892002836518062520_1186 at file build/test/data/dfs/data/data7/current/blk_-892002836518062520
2013-10-31 16:12:35,984 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7955453648049656030_1184 file build/test/data/dfs/data/data7/current/blk_7955453648049656030 for deletion
2013-10-31 16:12:35,984 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5312415671512961170_1183 at file build/test/data/dfs/data/data8/current/blk_5312415671512961170
2013-10-31 16:12:35,985 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7955453648049656030_1184 at file build/test/data/dfs/data/data7/current/blk_7955453648049656030
2013-10-31 16:12:35,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059958856430979839_1196 src: /127.0.0.1:35128 dest: /127.0.0.1:38271
2013-10-31 16:12:35,985 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-1059958856430979839_1196 to /127.0.0.1:38271
2013-10-31 16:12:35,985 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8736535815943837723_1185 file build/test/data/dfs/data/data8/current/blk_8736535815943837723 for deletion
2013-10-31 16:12:35,986 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8736535815943837723_1185 at file build/test/data/dfs/data/data8/current/blk_8736535815943837723
2013-10-31 16:12:35,988 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1059958856430979839_1196 src: /127.0.0.1:35128 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:12:35,990 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1059958856430979839_1196 size 238055
2013-10-31 16:12:36,402 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_1249937429 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:36,412 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20108 with signal TERM. Exit code 0
2013-10-31 16:12:36,575 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:36,575 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:36,575 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:36,575 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_1249937429 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:37,152 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0017
2013-10-31 16:12:37,153 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000000_0 not found in cache
2013-10-31 16:12:37,153 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000001_0 not found in cache
2013-10-31 16:12:37,154 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0017 for user-log deletion with retainTimeStamp:1383322357154
2013-10-31 16:12:37,453 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_-1672180280 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:37,462 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19774 with signal TERM. Exit code 0
2013-10-31 16:12:37,515 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000007_0 0.0% setup
2013-10-31 16:12:37,517 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000007_0 is done.
2013-10-31 16:12:37,517 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000007_0  was -1
2013-10-31 16:12:37,518 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:37,889 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0017
2013-10-31 16:12:37,889 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000003_0 not found in cache
2013-10-31 16:12:37,890 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000002_0 not found in cache
2013-10-31 16:12:37,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0017 for user-log deletion with retainTimeStamp:1383322357890
2013-10-31 16:12:38,032 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:38,032 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:38,032 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:38,033 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_-1672180280 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:38,158 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000007_0' has completed task_20131031160444934_0018_m_000007 successfully.
2013-10-31 16:12:38,162 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000000_0' to tip task_20131031160444934_0018_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:38,163 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000000
2013-10-31 16:12:38,164 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000001_0' to tip task_20131031160444934_0018_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:38,164 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000001
2013-10-31 16:12:38,166 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:12:38,169 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:12:38,169 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000000_0 which needs 1 slots
2013-10-31 16:12:38,169 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000000_0 which needs 1 slots
2013-10-31 16:12:38,170 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000001_0 which needs 1 slots
2013-10-31 16:12:38,170 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0018_m_000001_0 which needs 1 slots
2013-10-31 16:12:38,206 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_1660329901
2013-10-31 16:12:38,207 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_1660329901 spawned.
2013-10-31 16:12:38,208 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0018/attempt_20131031160444934_0018_m_000000_0. Attempting to reuse: jvm_20131031160444934_0018_m_630055656
2013-10-31 16:12:38,209 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000001_0/taskjvm.sh
2013-10-31 16:12:38,241 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_-1717478233 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:38,251 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19850 with signal TERM. Exit code 0
2013-10-31 16:12:38,304 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_183874956 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:38,312 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19885 with signal TERM. Exit code 0
2013-10-31 16:12:38,416 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_630055656 given task: attempt_20131031160444934_0018_m_000000_0
2013-10-31 16:12:38,427 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:38,427 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:38,427 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:38,427 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_-1717478233 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:38,452 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:38,453 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:38,453 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:12:38,453 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_183874956 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:38,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=null
2013-10-31 16:12:38,522 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48163, bytes: 2093, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7127854054404477716_1197, duration: 172082
2013-10-31 16:12:38,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:12:38,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:12:38,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:12:38,864 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35131, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 133983
2013-10-31 16:12:38,868 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55168, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 129142
2013-10-31 16:12:38,893 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000002_0' to tip task_20131031160444934_0018_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:12:38,893 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000002
2013-10-31 16:12:38,893 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000003_0' to tip task_20131031160444934_0018_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:12:38,893 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000003
2013-10-31 16:12:38,894 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:12:38,894 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:12:38,895 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000002_0 which needs 1 slots
2013-10-31 16:12:38,895 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000002_0 which needs 1 slots
2013-10-31 16:12:38,895 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000003_0 which needs 1 slots
2013-10-31 16:12:38,895 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0018_m_000003_0 which needs 1 slots
2013-10-31 16:12:38,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken	dst=null	perm=null
2013-10-31 16:12:38,898 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35133, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8179163193991924216_1202, duration: 144651
2013-10-31 16:12:38,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml	dst=null	perm=null
2013-10-31 16:12:38,903 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35136, bytes: 30160, op: HDFS_READ, cliID: DFSClient_419271258, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3022094558686490251_1199, duration: 181985
2013-10-31 16:12:38,916 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:38,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar	dst=null	perm=null
2013-10-31 16:12:38,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35137, bytes: 239915, op: HDFS_READ, cliID: DFSClient_419271258, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1059958856430979839_1196, duration: 714101
2013-10-31 16:12:39,016 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_-844750228
2013-10-31 16:12:39,017 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_-844750228 spawned.
2013-10-31 16:12:39,017 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_965492885
2013-10-31 16:12:39,017 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_965492885 spawned.
2013-10-31 16:12:39,018 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000002_0/taskjvm.sh
2013-10-31 16:12:39,019 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000003_0/taskjvm.sh
2013-10-31 16:12:39,046 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000004_0' to tip task_20131031160444934_0018_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:12:39,046 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000004
2013-10-31 16:12:39,047 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000005_0' to tip task_20131031160444934_0018_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:12:39,047 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000005
2013-10-31 16:12:39,048 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:12:39,049 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:12:39,049 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000004_0 which needs 1 slots
2013-10-31 16:12:39,049 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000004_0 which needs 1 slots
2013-10-31 16:12:39,050 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000005_0 which needs 1 slots
2013-10-31 16:12:39,050 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0018_m_000005_0 which needs 1 slots
2013-10-31 16:12:39,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken	dst=null	perm=null
2013-10-31 16:12:39,054 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55174, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8179163193991924216_1202, duration: 141600
2013-10-31 16:12:39,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml	dst=null	perm=null
2013-10-31 16:12:39,059 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35140, bytes: 30160, op: HDFS_READ, cliID: DFSClient_-2066064743, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3022094558686490251_1199, duration: 167135
2013-10-31 16:12:39,073 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:39,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar	dst=null	perm=null
2013-10-31 16:12:39,087 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48174, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2066064743, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1059958856430979839_1196, duration: 687439
2013-10-31 16:12:39,089 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_1660329901 given task: attempt_20131031160444934_0018_m_000001_0
2013-10-31 16:12:39,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=null
2013-10-31 16:12:39,613 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35074, bytes: 2093, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7127854054404477716_1197, duration: 170400
2013-10-31 16:12:39,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:12:39,653 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35075, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 270117
2013-10-31 16:12:39,680 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_-1217636009
2013-10-31 16:12:39,680 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_-1217636009 spawned.
2013-10-31 16:12:39,681 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_447578773
2013-10-31 16:12:39,681 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_447578773 spawned.
2013-10-31 16:12:39,682 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000005_0/taskjvm.sh
2013-10-31 16:12:39,683 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000004_0/taskjvm.sh
2013-10-31 16:12:39,839 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:12:39,846 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,851 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,857 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,868 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,873 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,873 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 16:12:40,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:12:40,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:12:40,069 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55181, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 140455
2013-10-31 16:12:40,476 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_-844750228 given task: attempt_20131031160444934_0018_m_000002_0
2013-10-31 16:12:40,692 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_-1217636009 given task: attempt_20131031160444934_0018_m_000005_0
2013-10-31 16:12:40,693 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_447578773 given task: attempt_20131031160444934_0018_m_000004_0
2013-10-31 16:12:40,734 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_965492885 given task: attempt_20131031160444934_0018_m_000003_0
2013-10-31 16:12:40,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=null
2013-10-31 16:12:40,989 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35151, bytes: 1577, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7127854054404477716_1197, duration: 167575
2013-10-31 16:12:41,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:41,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=null
2013-10-31 16:12:41,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=null
2013-10-31 16:12:41,193 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55191, bytes: 1061, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7127854054404477716_1197, duration: 161801
2013-10-31 16:12:41,195 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35156, bytes: 545, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000005_0, offset: 1536, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7127854054404477716_1197, duration: 260512
2013-10-31 16:12:41,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:41,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split	dst=null	perm=null
2013-10-31 16:12:41,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:41,233 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35088, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 175798
2013-10-31 16:12:41,235 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48191, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000005_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 107479
2013-10-31 16:12:41,238 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35090, bytes: 1061, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7127854054404477716_1197, duration: 158359
2013-10-31 16:12:41,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:12:41,280 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48193, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 133741
2013-10-31 16:12:41,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:41,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:41,317 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48194, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 134506
2013-10-31 16:12:41,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48195, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 110474
2013-10-31 16:12:41,483 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+26
2013-10-31 16:12:41,484 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000000_0 is done.
2013-10-31 16:12:41,484 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000000_0  was 557
2013-10-31 16:12:41,484 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:41,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:41,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:41,521 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55199, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 138142
2013-10-31 16:12:41,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:41,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:41,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55200, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000005_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 163243
2013-10-31 16:12:41,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:41,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:12:41,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35096, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 123375
2013-10-31 16:12:42,509 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+26
2013-10-31 16:12:42,513 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000001_0 is done.
2013-10-31 16:12:42,513 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000001_0  was 528
2013-10-31 16:12:42,513 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:42,942 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8580097153134000137_1001
2013-10-31 16:12:43,169 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0018_m_000007_0
2013-10-31 16:12:43,169 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0018_m_000007_0
2013-10-31 16:12:43,170 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0018_m_000007_0 not found in cache
2013-10-31 16:12:43,918 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+6
2013-10-31 16:12:43,920 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000002_0 is done.
2013-10-31 16:12:43,920 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000002_0  was 64
2013-10-31 16:12:43,920 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:44,121 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000005_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:18+1
2013-10-31 16:12:44,123 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+6
2013-10-31 16:12:44,124 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000005_0 is done.
2013-10-31 16:12:44,124 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000005_0  was 6
2013-10-31 16:12:44,125 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:44,125 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000004_0 is done.
2013-10-31 16:12:44,125 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000004_0  was 64
2013-10-31 16:12:44,126 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:44,162 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:6+6
2013-10-31 16:12:44,163 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000003_0 is done.
2013-10-31 16:12:44,163 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000003_0  was 35
2013-10-31 16:12:44,163 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:44,170 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000000_0' has completed task_20131031160444934_0018_m_000000 successfully.
2013-10-31 16:12:44,170 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000001_0' has completed task_20131031160444934_0018_m_000001 successfully.
2013-10-31 16:12:44,171 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0018_r_000000_0' to tip task_20131031160444934_0018_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:44,172 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:12:44,172 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_r_000000_0 which needs 1 slots
2013-10-31 16:12:44,172 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_r_000000_0 which needs 1 slots
2013-10-31 16:12:44,192 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_r_-245324502
2013-10-31 16:12:44,193 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_r_-245324502 spawned.
2013-10-31 16:12:44,195 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_r_000000_0/taskjvm.sh
2013-10-31 16:12:44,901 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000002_0' has completed task_20131031160444934_0018_m_000002 successfully.
2013-10-31 16:12:44,902 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000003_0' has completed task_20131031160444934_0018_m_000003 successfully.
2013-10-31 16:12:45,055 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000004_0' has completed task_20131031160444934_0018_m_000004 successfully.
2013-10-31 16:12:45,056 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000005_0' has completed task_20131031160444934_0018_m_000005 successfully.
2013-10-31 16:12:45,251 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_r_-245324502 given task: attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:12:50,930 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46892, bytes: 557, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000000_0, duration: 10052106
2013-10-31 16:12:50,956 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46892, bytes: 528, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000001_0, duration: 11769555
2013-10-31 16:12:50,975 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:47700, bytes: 64, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000002_0, duration: 13580545
2013-10-31 16:12:50,995 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:47701, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000003_0, duration: 12083574
2013-10-31 16:12:51,013 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58827, bytes: 64, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000004_0, duration: 12669815
2013-10-31 16:12:51,028 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58827, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000005_0, duration: 11623837
2013-10-31 16:12:51,724 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:12:51,788 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:12:51,851 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:12:52,036 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1075 Total time for transactions(ms): 21Number of transactions batched in Syncs: 106 Number of syncs: 765 SyncTimes(ms): 32470 4769 
2013-10-31 16:12:52,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:52,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:52,722 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000. blk_2748725046508282754_1203
2013-10-31 16:12:52,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2748725046508282754_1203 src: /127.0.0.1:55208 dest: /127.0.0.1:41648
2013-10-31 16:12:52,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2748725046508282754_1203 src: /127.0.0.1:48206 dest: /127.0.0.1:47311
2013-10-31 16:12:52,766 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2748725046508282754_1203 src: /127.0.0.1:35174 dest: /127.0.0.1:38271
2013-10-31 16:12:52,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35174, dest: /127.0.0.1:38271, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0018_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2748725046508282754_1203, duration: 959690
2013-10-31 16:12:52,768 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2748725046508282754_1203 terminating
2013-10-31 16:12:52,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48206, dest: /127.0.0.1:47311, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0018_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2748725046508282754_1203, duration: 1340515
2013-10-31 16:12:52,770 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2748725046508282754_1203 terminating
2013-10-31 16:12:52,770 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2748725046508282754_1203 size 336
2013-10-31 16:12:52,770 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55208, dest: /127.0.0.1:41648, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0018_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2748725046508282754_1203, duration: 3562147
2013-10-31 16:12:52,771 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2748725046508282754_1203 terminating
2013-10-31 16:12:52,771 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2748725046508282754_1203 size 336
2013-10-31 16:12:52,773 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2748725046508282754_1203 size 336
2013-10-31 16:12:52,773 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:12:52,773 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:12:52,810 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0018_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:52,811 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:12:53,183 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   6 OK for attempt_20131031160444934_0018_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:12:53,184 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:12:53,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0	dst=null	perm=null
2013-10-31 16:12:53,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:53,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:53,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0	dst=null	perm=null
2013-10-31 16:12:54,777 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 1.0% reduce > reduce
2013-10-31 16:12:54,780 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 1.0% reduce > reduce
2013-10-31 16:12:54,781 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_r_000000_0 is done.
2013-10-31 16:12:54,781 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_r_000000_0  was -1
2013-10-31 16:12:54,781 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:56,187 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_r_000000_0' has completed task_20131031160444934_0018_r_000000 successfully.
2013-10-31 16:12:56,192 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0018_m_000006_0' to tip task_20131031160444934_0018_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:56,195 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:12:56,195 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000006_0 which needs 1 slots
2013-10-31 16:12:56,196 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000006_0 which needs 1 slots
2013-10-31 16:12:56,226 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0018/attempt_20131031160444934_0018_m_000006_0. Attempting to reuse: jvm_20131031160444934_0018_m_630055656
2013-10-31 16:12:57,017 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_630055656 given task: attempt_20131031160444934_0018_m_000006_0
2013-10-31 16:12:57,120 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000006_0 0.0% 
2013-10-31 16:12:57,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary	dst=null	perm=null
2013-10-31 16:12:57,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:57,135 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS from client DFSClient_attempt_20131031160444934_0018_m_000006_0
2013-10-31 16:12:57,135 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0018_m_000006_0
2013-10-31 16:12:57,141 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059958856430979839 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:57,142 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059958856430979839 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:57,142 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059958856430979839 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:57,142 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059958856430979839 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:57,142 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7127854054404477716 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:57,143 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7127854054404477716 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:57,143 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7127854054404477716 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:57,143 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7127854054404477716 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:57,143 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2560831434870646292 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:57,144 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2560831434870646292 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:57,144 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2560831434870646292 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:57,144 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3022094558686490251 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:57,144 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3022094558686490251 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:57,144 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3022094558686490251 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:57,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018	dst=null	perm=null
2013-10-31 16:12:57,253 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_7127854054404477716_1197 blk_-2560831434870646292_1198 blk_-1059958856430979839_1196 blk_3022094558686490251_1199
2013-10-31 16:12:57,253 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_7127854054404477716_1197 blk_-2560831434870646292_1198 blk_-1059958856430979839_1196
2013-10-31 16:12:57,387 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2560831434870646292_1198 file build/test/data/dfs/data/data3/current/blk_-2560831434870646292 for deletion
2013-10-31 16:12:57,387 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059958856430979839_1196 file build/test/data/dfs/data/data3/current/blk_-1059958856430979839 for deletion
2013-10-31 16:12:57,387 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2560831434870646292_1198 at file build/test/data/dfs/data/data3/current/blk_-2560831434870646292
2013-10-31 16:12:57,387 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7127854054404477716_1197 file build/test/data/dfs/data/data4/current/blk_7127854054404477716 for deletion
2013-10-31 16:12:57,388 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059958856430979839_1196 at file build/test/data/dfs/data/data3/current/blk_-1059958856430979839
2013-10-31 16:12:57,388 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7127854054404477716_1197 at file build/test/data/dfs/data/data4/current/blk_7127854054404477716
2013-10-31 16:12:59,788 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2560831434870646292_1198 file build/test/data/dfs/data/data2/current/blk_-2560831434870646292 for deletion
2013-10-31 16:12:59,788 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059958856430979839_1196 file build/test/data/dfs/data/data1/current/blk_-1059958856430979839 for deletion
2013-10-31 16:12:59,788 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2560831434870646292_1198 at file build/test/data/dfs/data/data2/current/blk_-2560831434870646292
2013-10-31 16:12:59,788 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3022094558686490251_1199 file build/test/data/dfs/data/data1/current/blk_3022094558686490251 for deletion
2013-10-31 16:12:59,789 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059958856430979839_1196 at file build/test/data/dfs/data/data1/current/blk_-1059958856430979839
2013-10-31 16:12:59,789 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7127854054404477716_1197 file build/test/data/dfs/data/data1/current/blk_7127854054404477716 for deletion
2013-10-31 16:12:59,789 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3022094558686490251_1199 at file build/test/data/dfs/data/data1/current/blk_3022094558686490251
2013-10-31 16:12:59,789 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7127854054404477716_1197 at file build/test/data/dfs/data/data1/current/blk_7127854054404477716
2013-10-31 16:13:00,093 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000006_0 0.0% cleanup
2013-10-31 16:13:00,095 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000006_0 is done.
2013-10-31 16:13:00,095 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000006_0  was -1
2013-10-31 16:13:00,096 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:00,253 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_7127854054404477716_1197 blk_-2560831434870646292_1198 blk_-1059958856430979839_1196 blk_3022094558686490251_1199
2013-10-31 16:13:00,254 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_7127854054404477716_1197 blk_-1059958856430979839_1196 blk_3022094558686490251_1199
2013-10-31 16:13:01,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2560831434870646292_1198 file build/test/data/dfs/data/data5/current/blk_-2560831434870646292 for deletion
2013-10-31 16:13:01,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059958856430979839_1196 file build/test/data/dfs/data/data5/current/blk_-1059958856430979839 for deletion
2013-10-31 16:13:01,002 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2560831434870646292_1198 at file build/test/data/dfs/data/data5/current/blk_-2560831434870646292
2013-10-31 16:13:01,002 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3022094558686490251_1199 file build/test/data/dfs/data/data6/current/blk_3022094558686490251 for deletion
2013-10-31 16:13:01,003 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059958856430979839_1196 at file build/test/data/dfs/data/data5/current/blk_-1059958856430979839
2013-10-31 16:13:01,003 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3022094558686490251_1199 at file build/test/data/dfs/data/data6/current/blk_3022094558686490251
2013-10-31 16:13:01,003 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7127854054404477716_1197 file build/test/data/dfs/data/data6/current/blk_7127854054404477716 for deletion
2013-10-31 16:13:01,004 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7127854054404477716_1197 at file build/test/data/dfs/data/data6/current/blk_7127854054404477716
2013-10-31 16:13:01,195 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:13:01,196 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:13:02,203 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000006_0' has completed task_20131031160444934_0018_m_000006 successfully.
2013-10-31 16:13:02,204 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0018 has completed successfully.
2013-10-31 16:13:02,205 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0018,submitTime=1383235951164,launchTime=1383235951263,firstMapTaskLaunchTime=1383235958162,firstReduceTaskLaunchTime=1383235964171,firstJobSetupTaskLaunchTime=1383235952143,firstJobCleanupTaskLaunchTime=1383235976192,finishTime=1383235982204,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=35,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2661D9EFBCFC4D2584DAE2E7CA0A0B8B/B99E6D0C38F347C7BE0E1DD6FC639A83] merging/(1/1) ...platform/joinsintogroupby
2013-10-31 16:13:02,212 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7. blk_7127116701397707812_1204
2013-10-31 16:13:02,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127116701397707812_1204 src: /127.0.0.1:35110 dest: /127.0.0.1:50942
2013-10-31 16:13:02,218 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127116701397707812_1204 src: /127.0.0.1:35180 dest: /127.0.0.1:38271
2013-10-31 16:13:02,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127116701397707812_1204 src: /127.0.0.1:48214 dest: /127.0.0.1:47311
2013-10-31 16:13:02,223 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48214, dest: /127.0.0.1:47311, bytes: 35429, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7127116701397707812_1204, duration: 487788
2013-10-31 16:13:02,223 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7127116701397707812_1204 terminating
2013-10-31 16:13:02,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35180, dest: /127.0.0.1:38271, bytes: 35429, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7127116701397707812_1204, duration: 1278813
2013-10-31 16:13:02,224 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7127116701397707812_1204 terminating
2013-10-31 16:13:02,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35110, dest: /127.0.0.1:50942, bytes: 35429, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7127116701397707812_1204, duration: 2132962
2013-10-31 16:13:02,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7127116701397707812_1204 terminating
2013-10-31 16:13:02,230 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7127116701397707812_1204 size 35429
2013-10-31 16:13:02,231 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7 from client DFSClient_-1577091776
2013-10-31 16:13:02,233 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7 is closed by DFSClient_-1577091776
2013-10-31 16:13:02,233 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7127116701397707812_1204 size 35429
2013-10-31 16:13:02,234 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7127116701397707812_1204 size 35429
2013-10-31 16:13:02,239 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:02,240 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000000_0'
2013-10-31 16:13:02,240 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000001_0'
2013-10-31 16:13:02,240 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000006_0'
2013-10-31 16:13:02,241 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000007_0'
2013-10-31 16:13:02,242 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8179163193991924216 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:02,242 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_r_000000_0'
2013-10-31 16:13:02,242 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8179163193991924216 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:02,242 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8179163193991924216 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:02,245 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0018_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:02,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018	dst=null	perm=null
2013-10-31 16:13:02,249 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary
2013-10-31 16:13:02,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2013-10-31 16:13:02,269 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:02,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2013-10-31 16:13:02,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2013-10-31 16:13:02,274 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48216, bytes: 340, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2748725046508282754_1203, duration: 283325
2013-10-31 16:13:02,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2013-10-31 16:13:02,294 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:02,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2013-10-31 16:13:02,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2013-10-31 16:13:02,298 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35184, bytes: 340, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2748725046508282754_1203, duration: 282773
2013-10-31 16:13:02,299 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintogroupby
2013-10-31 16:13:02,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2013-10-31 16:13:02,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2013-10-31 16:13:02,305 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35185, bytes: 340, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2748725046508282754_1203, duration: 268824
2013-10-31 16:13:02,313 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:13:02,314 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:13:02,325 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:13:02,325 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:13:02,325 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:13:02,326 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown"]
2013-10-31 16:13:02,326 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:13:02,326 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:13:02,327 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:13:02,328 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...ldedpipesplatform/unknown
2013-10-31 16:13:02,333 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:13:02,334 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:13:02,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:02,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:13:02,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:02,357 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar. blk_-2795355961709381774_1205
2013-10-31 16:13:02,359 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2795355961709381774_1205 src: /127.0.0.1:35186 dest: /127.0.0.1:38271
2013-10-31 16:13:02,360 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2795355961709381774_1205 src: /127.0.0.1:48220 dest: /127.0.0.1:47311
2013-10-31 16:13:02,362 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2795355961709381774_1205 src: /127.0.0.1:55224 dest: /127.0.0.1:41648
2013-10-31 16:13:02,373 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55224, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2795355961709381774_1205, duration: 7588631
2013-10-31 16:13:02,374 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2795355961709381774_1205 terminating
2013-10-31 16:13:02,374 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48220, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2795355961709381774_1205, duration: 8461389
2013-10-31 16:13:02,375 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2795355961709381774_1205 terminating
2013-10-31 16:13:02,375 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35186, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2795355961709381774_1205, duration: 9441779
2013-10-31 16:13:02,376 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2795355961709381774_1205 terminating
2013-10-31 16:13:02,378 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2795355961709381774_1205 size 238055
2013-10-31 16:13:02,379 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar from client DFSClient_1457307213
2013-10-31 16:13:02,379 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar is closed by DFSClient_1457307213
2013-10-31 16:13:02,380 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2795355961709381774_1205 size 238055
2013-10-31 16:13:02,380 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2795355961709381774_1205 size 238055
2013-10-31 16:13:02,387 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar. New replication is 10
2013-10-31 16:13:02,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar	dst=null	perm=null
2013-10-31 16:13:02,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:02,403 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:13:02,407 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:02,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:02,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:02,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:02,428 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split. New replication is 10
2013-10-31 16:13:02,924 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000002_0'
2013-10-31 16:13:02,924 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000003_0'
2013-10-31 16:13:02,992 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059958856430979839_1196 file build/test/data/dfs/data/data7/current/blk_-1059958856430979839 for deletion
2013-10-31 16:13:02,992 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3022094558686490251_1199 file build/test/data/dfs/data/data7/current/blk_3022094558686490251 for deletion
2013-10-31 16:13:02,992 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059958856430979839_1196 at file build/test/data/dfs/data/data7/current/blk_-1059958856430979839
2013-10-31 16:13:02,992 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7127854054404477716_1197 file build/test/data/dfs/data/data8/current/blk_7127854054404477716 for deletion
2013-10-31 16:13:02,993 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3022094558686490251_1199 at file build/test/data/dfs/data/data7/current/blk_3022094558686490251
2013-10-31 16:13:02,993 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7127854054404477716_1197 at file build/test/data/dfs/data/data8/current/blk_7127854054404477716
2013-10-31 16:13:03,076 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000004_0'
2013-10-31 16:13:03,076 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000005_0'
2013-10-31 16:13:03,088 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0018
2013-10-31 16:13:03,089 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0018 being deleted.
2013-10-31 16:13:03,255 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-2795355961709381774_1205 to datanode(s) 127.0.0.1:50942
2013-10-31 16:13:03,255 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_8179163193991924216_1202
2013-10-31 16:13:03,255 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_8179163193991924216_1202
2013-10-31 16:13:03,389 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-2795355961709381774_1205 to 127.0.0.1:50942 
2013-10-31 16:13:03,389 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8179163193991924216_1202 file build/test/data/dfs/data/data3/current/blk_8179163193991924216 for deletion
2013-10-31 16:13:03,390 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8179163193991924216_1202 at file build/test/data/dfs/data/data3/current/blk_8179163193991924216
2013-10-31 16:13:03,391 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2795355961709381774_1205 src: /127.0.0.1:35120 dest: /127.0.0.1:50942
2013-10-31 16:13:03,391 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-2795355961709381774_1205 to /127.0.0.1:50942
2013-10-31 16:13:03,394 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2795355961709381774_1205 src: /127.0.0.1:35120 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:13:03,398 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2795355961709381774_1205 size 238055
2013-10-31 16:13:03,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split	dst=null	perm=null
2013-10-31 16:13:03,534 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split. blk_8781975787346649086_1206
2013-10-31 16:13:03,535 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8781975787346649086_1206 src: /127.0.0.1:35121 dest: /127.0.0.1:50942
2013-10-31 16:13:03,537 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8781975787346649086_1206 src: /127.0.0.1:55227 dest: /127.0.0.1:41648
2013-10-31 16:13:03,537 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8781975787346649086_1206 src: /127.0.0.1:35192 dest: /127.0.0.1:38271
2013-10-31 16:13:03,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8781975787346649086_1206 src: /127.0.0.1:48226 dest: /127.0.0.1:47311
2013-10-31 16:13:03,542 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48226, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8781975787346649086_1206, duration: 106903
2013-10-31 16:13:03,542 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8781975787346649086_1206 terminating
2013-10-31 16:13:03,543 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35192, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8781975787346649086_1206, duration: 1018794
2013-10-31 16:13:03,543 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8781975787346649086_1206 terminating
2013-10-31 16:13:03,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55227, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8781975787346649086_1206, duration: 1962823
2013-10-31 16:13:03,544 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8781975787346649086_1206 terminating
2013-10-31 16:13:03,545 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35121, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8781975787346649086_1206, duration: 2890926
2013-10-31 16:13:03,545 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8781975787346649086_1206 terminating
2013-10-31 16:13:03,546 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8781975787346649086_1206 size 1732
2013-10-31 16:13:03,549 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split from client DFSClient_1457307213
2013-10-31 16:13:03,549 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split is closed by DFSClient_1457307213
2013-10-31 16:13:03,550 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8781975787346649086_1206 size 1732
2013-10-31 16:13:03,550 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8781975787346649086_1206 size 1732
2013-10-31 16:13:03,551 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8781975787346649086_1206 size 1732
2013-10-31 16:13:03,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,570 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo. blk_8067882842254612962_1207
2013-10-31 16:13:03,571 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8067882842254612962_1207 src: /127.0.0.1:35194 dest: /127.0.0.1:38271
2013-10-31 16:13:03,573 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8067882842254612962_1207 src: /127.0.0.1:35126 dest: /127.0.0.1:50942
2013-10-31 16:13:03,574 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8067882842254612962_1207 src: /127.0.0.1:48229 dest: /127.0.0.1:47311
2013-10-31 16:13:03,577 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48229, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8067882842254612962_1207, duration: 64540
2013-10-31 16:13:03,577 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8067882842254612962_1207 terminating
2013-10-31 16:13:03,578 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35126, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8067882842254612962_1207, duration: 835831
2013-10-31 16:13:03,578 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8067882842254612962_1207 terminating
2013-10-31 16:13:03,579 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35194, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8067882842254612962_1207, duration: 1677517
2013-10-31 16:13:03,579 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8067882842254612962_1207 terminating
2013-10-31 16:13:03,581 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8067882842254612962_1207 size 183
2013-10-31 16:13:03,581 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:13:03,582 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:13:03,582 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8067882842254612962_1207 size 183
2013-10-31 16:13:03,583 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8067882842254612962_1207 size 183
2013-10-31 16:13:03,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,607 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml. blk_2067163295264048629_1208
2013-10-31 16:13:03,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2067163295264048629_1208 src: /127.0.0.1:35197 dest: /127.0.0.1:38271
2013-10-31 16:13:03,610 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2067163295264048629_1208 src: /127.0.0.1:55234 dest: /127.0.0.1:41648
2013-10-31 16:13:03,612 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2067163295264048629_1208 src: /127.0.0.1:35130 dest: /127.0.0.1:50942
2013-10-31 16:13:03,615 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35130, dest: /127.0.0.1:50942, bytes: 28312, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2067163295264048629_1208, duration: 388357
2013-10-31 16:13:03,615 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2067163295264048629_1208 terminating
2013-10-31 16:13:03,616 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55234, dest: /127.0.0.1:41648, bytes: 28312, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2067163295264048629_1208, duration: 1146700
2013-10-31 16:13:03,616 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2067163295264048629_1208 terminating
2013-10-31 16:13:03,617 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35197, dest: /127.0.0.1:38271, bytes: 28312, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2067163295264048629_1208, duration: 2070632
2013-10-31 16:13:03,617 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2067163295264048629_1208 terminating
2013-10-31 16:13:03,620 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2067163295264048629_1208 size 28312
2013-10-31 16:13:03,621 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml from client DFSClient_1457307213
2013-10-31 16:13:03,621 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml is closed by DFSClient_1457307213
2013-10-31 16:13:03,621 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2067163295264048629_1208 size 28312
2013-10-31 16:13:03,622 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2067163295264048629_1208 size 28312
2013-10-31 16:13:03,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml	dst=null	perm=null
2013-10-31 16:13:03,638 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35201, bytes: 28536, op: HDFS_READ, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2067163295264048629_1208, duration: 416592
2013-10-31 16:13:03,657 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0019: nMaps=5 nReduces=0 max=-1
2013-10-31 16:13:03,658 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0019 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:13:03,658 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0019	RESULT=SUCCESS
2013-10-31 16:13:03,658 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0019
2013-10-31 16:13:03,658 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0019
2013-10-31 16:13:03,660 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0019
2013-10-31 16:13:03,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,693 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_conf.xml. blk_5577773797244675932_1210
2013-10-31 16:13:03,694 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5577773797244675932_1210 src: /127.0.0.1:48235 dest: /127.0.0.1:47311
2013-10-31 16:13:03,695 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5577773797244675932_1210 src: /127.0.0.1:35134 dest: /127.0.0.1:50942
2013-10-31 16:13:03,696 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5577773797244675932_1210 src: /127.0.0.1:35204 dest: /127.0.0.1:38271
2013-10-31 16:13:03,699 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35204, dest: /127.0.0.1:38271, bytes: 28377, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5577773797244675932_1210, duration: 680608
2013-10-31 16:13:03,699 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5577773797244675932_1210 terminating
2013-10-31 16:13:03,700 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35134, dest: /127.0.0.1:50942, bytes: 28377, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5577773797244675932_1210, duration: 1442267
2013-10-31 16:13:03,700 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5577773797244675932_1210 terminating
2013-10-31 16:13:03,700 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48235, dest: /127.0.0.1:47311, bytes: 28377, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5577773797244675932_1210, duration: 1993037
2013-10-31 16:13:03,701 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5577773797244675932_1210 size 28377
2013-10-31 16:13:03,701 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5577773797244675932_1210 terminating
2013-10-31 16:13:03,704 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5577773797244675932_1210 size 28377
2013-10-31 16:13:03,704 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_conf.xml from client DFSClient_-1583062373
2013-10-31 16:13:03,704 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_conf.xml is closed by DFSClient_-1583062373
2013-10-31 16:13:03,705 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5577773797244675932_1210 size 28377
2013-10-31 16:13:03,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,713 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken. blk_-5892293765468690806_1211
2013-10-31 16:13:03,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5892293765468690806_1211 src: /127.0.0.1:35205 dest: /127.0.0.1:38271
2013-10-31 16:13:03,717 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5892293765468690806_1211 src: /127.0.0.1:48239 dest: /127.0.0.1:47311
2013-10-31 16:13:03,718 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5892293765468690806_1211 src: /127.0.0.1:35138 dest: /127.0.0.1:50942
2013-10-31 16:13:03,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35138, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5892293765468690806_1211, duration: 669669
2013-10-31 16:13:03,720 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5892293765468690806_1211 terminating
2013-10-31 16:13:03,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48239, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5892293765468690806_1211, duration: 998294
2013-10-31 16:13:03,720 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5892293765468690806_1211 terminating
2013-10-31 16:13:03,721 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35205, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5892293765468690806_1211, duration: 1059427
2013-10-31 16:13:03,721 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5892293765468690806_1211 terminating
2013-10-31 16:13:03,725 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5892293765468690806_1211 size 116
2013-10-31 16:13:03,725 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken from client DFSClient_1457307213
2013-10-31 16:13:03,725 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken is closed by DFSClient_1457307213
2013-10-31 16:13:03,726 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5892293765468690806_1211 size 116
2013-10-31 16:13:03,726 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5892293765468690806_1211 size 116
2013-10-31 16:13:03,729 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken
2013-10-31 16:13:03,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:13:03,732 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48241, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8067882842254612962_1207, duration: 126803
2013-10-31 16:13:03,734 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0019 = 19. Number of splits = 5
2013-10-31 16:13:03,734 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,734 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,735 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,735 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,735 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,735 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,736 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,736 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,736 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,736 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,738 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0019 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:13:03,738 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0019 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:13:04,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8179163193991924216_1202 file build/test/data/dfs/data/data6/current/blk_8179163193991924216 for deletion
2013-10-31 16:13:04,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8179163193991924216_1202 at file build/test/data/dfs/data/data6/current/blk_8179163193991924216
2013-10-31 16:13:05,247 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0019_m_000006_0' to tip task_20131031160444934_0019_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:13:05,254 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:13:05,254 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000006_0 which needs 1 slots
2013-10-31 16:13:05,255 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000006_0 which needs 1 slots
2013-10-31 16:13:05,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken	dst=null	perm=null
2013-10-31 16:13:05,261 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48242, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5892293765468690806_1211, duration: 317296
2013-10-31 16:13:05,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml	dst=null	perm=null
2013-10-31 16:13:05,267 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35211, bytes: 28536, op: HDFS_READ, cliID: DFSClient_-510896954, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2067163295264048629_1208, duration: 417422
2013-10-31 16:13:05,285 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:05,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar	dst=null	perm=null
2013-10-31 16:13:05,314 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35212, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-510896954, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2795355961709381774_1205, duration: 1611291
2013-10-31 16:13:05,423 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0018_m_1660329901
2013-10-31 16:13:05,428 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20415 with signal TERM. Exit code 0
2013-10-31 16:13:05,428 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_226989341
2013-10-31 16:13:05,429 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_226989341 spawned.
2013-10-31 16:13:05,437 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000006_0/taskjvm.sh
2013-10-31 16:13:05,521 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:05,521 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:05,521 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:05,523 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_1660329901 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:06,256 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_8179163193991924216_1202
2013-10-31 16:13:06,886 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_226989341 given task: attempt_20131031160444934_0019_m_000006_0
2013-10-31 16:13:07,243 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0018
2013-10-31 16:13:07,243 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0018_m_000006_0 not found in cache
2013-10-31 16:13:07,244 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0018 for user-log deletion with retainTimeStamp:1383322387243
2013-10-31 16:13:07,320 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_r_-245324502 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:07,329 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20801 with signal TERM. Exit code 0
2013-10-31 16:13:07,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:07,495 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:07,495 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:07,496 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:07,496 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_r_-245324502 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:07,925 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0018
2013-10-31 16:13:07,926 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0018 for user-log deletion with retainTimeStamp:1383322387926
2013-10-31 16:13:08,077 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0018
2013-10-31 16:13:08,079 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0018 for user-log deletion with retainTimeStamp:1383322388079
2013-10-31 16:13:08,133 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_630055656 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,141 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20285 with signal TERM. Exit code 0
2013-10-31 16:13:08,324 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,324 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,324 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:08,325 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_630055656 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:13:08,496 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_-844750228 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,506 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20536 with signal TERM. Exit code 0
2013-10-31 16:13:08,690 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_-1217636009 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,700 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20603 with signal TERM. Exit code 0
2013-10-31 16:13:08,707 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_447578773 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,717 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20602 with signal TERM. Exit code 0
2013-10-31 16:13:08,722 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_965492885 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,727 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,727 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,727 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:08,731 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20572 with signal TERM. Exit code 0
2013-10-31 16:13:08,731 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_-844750228 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:08,790 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8179163193991924216_1202 file build/test/data/dfs/data/data2/current/blk_8179163193991924216 for deletion
2013-10-31 16:13:08,791 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8179163193991924216_1202 at file build/test/data/dfs/data/data2/current/blk_8179163193991924216
2013-10-31 16:13:08,921 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,921 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,921 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:08,921 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_-1217636009 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:08,924 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,924 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,925 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:08,925 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_447578773 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:08,927 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,928 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,928 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:08,928 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_965492885 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:10,299 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000006_0 0.0% setup
2013-10-31 16:13:10,302 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000006_0 is done.
2013-10-31 16:13:10,303 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000006_0  was -1
2013-10-31 16:13:10,303 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:11,259 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000006_0' has completed task_20131031160444934_0019_m_000006 successfully.
2013-10-31 16:13:11,263 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000000_0' to tip task_20131031160444934_0019_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:13:11,264 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000000
2013-10-31 16:13:11,265 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000001_0' to tip task_20131031160444934_0019_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:13:11,265 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000001
2013-10-31 16:13:11,267 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:13:11,268 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:13:11,268 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000000_0 which needs 1 slots
2013-10-31 16:13:11,268 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000000_0 which needs 1 slots
2013-10-31 16:13:11,269 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000001_0 which needs 1 slots
2013-10-31 16:13:11,269 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0019_m_000001_0 which needs 1 slots
2013-10-31 16:13:11,306 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_-1462732907
2013-10-31 16:13:11,307 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_-1462732907 spawned.
2013-10-31 16:13:11,307 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0019/attempt_20131031160444934_0019_m_000000_0. Attempting to reuse: jvm_20131031160444934_0019_m_226989341
2013-10-31 16:13:11,308 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000001_0/taskjvm.sh
2013-10-31 16:13:11,372 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_226989341 given task: attempt_20131031160444934_0019_m_000000_0
2013-10-31 16:13:11,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split	dst=null	perm=null
2013-10-31 16:13:11,476 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55252, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8781975787346649086_1206, duration: 173766
2013-10-31 16:13:11,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:11,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:11,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:11,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:11,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:11,831 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48250, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 135868
2013-10-31 16:13:11,833 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35218, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 101747
2013-10-31 16:13:11,840 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000. blk_-1978869255100246022_1212
2013-10-31 16:13:11,856 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1978869255100246022_1212 src: /127.0.0.1:55255 dest: /127.0.0.1:41648
2013-10-31 16:13:11,857 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1978869255100246022_1212 src: /127.0.0.1:35151 dest: /127.0.0.1:50942
2013-10-31 16:13:11,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1978869255100246022_1212 src: /127.0.0.1:35221 dest: /127.0.0.1:38271
2013-10-31 16:13:11,860 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35221, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1978869255100246022_1212, duration: 1280587
2013-10-31 16:13:11,860 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1978869255100246022_1212 terminating
2013-10-31 16:13:11,860 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35151, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1978869255100246022_1212, duration: 1725048
2013-10-31 16:13:11,860 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1978869255100246022_1212 terminating
2013-10-31 16:13:11,861 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55255, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1978869255100246022_1212, duration: 2112135
2013-10-31 16:13:11,861 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1978869255100246022_1212 terminating
2013-10-31 16:13:11,861 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1978869255100246022_1212 size 8
2013-10-31 16:13:11,862 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1978869255100246022_1212 size 8
2013-10-31 16:13:11,863 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0019_m_000000_0
2013-10-31 16:13:11,863 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0019_m_000000_0
2013-10-31 16:13:11,863 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1978869255100246022_1212 size 8
2013-10-31 16:13:11,904 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:11,904 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000000_0 0.0% 
2013-10-31 16:13:11,934 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000002_0' to tip task_20131031160444934_0019_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:11,934 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000002
2013-10-31 16:13:11,934 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000003_0' to tip task_20131031160444934_0019_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:11,934 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000003
2013-10-31 16:13:11,935 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:13:11,936 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:13:11,936 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000002_0 which needs 1 slots
2013-10-31 16:13:11,936 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000002_0 which needs 1 slots
2013-10-31 16:13:11,936 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000003_0 which needs 1 slots
2013-10-31 16:13:11,936 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0019_m_000003_0 which needs 1 slots
2013-10-31 16:13:11,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken	dst=null	perm=null
2013-10-31 16:13:11,940 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35222, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5892293765468690806_1211, duration: 131388
2013-10-31 16:13:11,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml	dst=null	perm=null
2013-10-31 16:13:11,944 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35224, bytes: 28536, op: HDFS_READ, cliID: DFSClient_1810471541, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2067163295264048629_1208, duration: 168343
2013-10-31 16:13:11,957 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:11,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar	dst=null	perm=null
2013-10-31 16:13:11,971 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55262, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1810471541, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2795355961709381774_1205, duration: 704108
2013-10-31 16:13:12,025 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_235871377
2013-10-31 16:13:12,026 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_235871377 spawned.
2013-10-31 16:13:12,027 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000002_0/taskjvm.sh
2013-10-31 16:13:12,028 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_1122384754
2013-10-31 16:13:12,028 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_1122384754 spawned.
2013-10-31 16:13:12,029 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000003_0/taskjvm.sh
2013-10-31 16:13:12,086 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000004_0' to tip task_20131031160444934_0019_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:13:12,086 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000004
2013-10-31 16:13:12,088 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:13:12,088 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000004_0 which needs 1 slots
2013-10-31 16:13:12,088 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000004_0 which needs 1 slots
2013-10-31 16:13:12,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken	dst=null	perm=null
2013-10-31 16:13:12,095 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35227, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5892293765468690806_1211, duration: 300469
2013-10-31 16:13:12,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml	dst=null	perm=null
2013-10-31 16:13:12,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35160, bytes: 28536, op: HDFS_READ, cliID: DFSClient_1753422640, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2067163295264048629_1208, duration: 183142
2013-10-31 16:13:12,125 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:12,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar	dst=null	perm=null
2013-10-31 16:13:12,140 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35161, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1753422640, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2795355961709381774_1205, duration: 643070
2013-10-31 16:13:12,143 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_-1462732907 given task: attempt_20131031160444934_0019_m_000001_0
2013-10-31 16:13:12,252 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_-1452522867
2013-10-31 16:13:12,253 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_-1452522867 spawned.
2013-10-31 16:13:12,254 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000004_0/taskjvm.sh
2013-10-31 16:13:12,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split	dst=null	perm=null
2013-10-31 16:13:12,721 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35232, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8781975787346649086_1206, duration: 166623
2013-10-31 16:13:12,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:12,761 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35164, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 134941
2013-10-31 16:13:12,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:12,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:12,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:12,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:12,991 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55271, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 132411
2013-10-31 16:13:13,002 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001. blk_-1793475109059110368_1213
2013-10-31 16:13:13,026 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_235871377 given task: attempt_20131031160444934_0019_m_000002_0
2013-10-31 16:13:13,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1793475109059110368_1213 src: /127.0.0.1:48269 dest: /127.0.0.1:47311
2013-10-31 16:13:13,035 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1793475109059110368_1213 src: /127.0.0.1:35168 dest: /127.0.0.1:50942
2013-10-31 16:13:13,036 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1793475109059110368_1213 src: /127.0.0.1:55274 dest: /127.0.0.1:41648
2013-10-31 16:13:13,039 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55274, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1793475109059110368_1213, duration: 1591364
2013-10-31 16:13:13,039 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1793475109059110368_1213 terminating
2013-10-31 16:13:13,039 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35168, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1793475109059110368_1213, duration: 1929622
2013-10-31 16:13:13,039 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1793475109059110368_1213 terminating
2013-10-31 16:13:13,039 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1793475109059110368_1213 size 8
2013-10-31 16:13:13,040 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48269, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1793475109059110368_1213, duration: 2477158
2013-10-31 16:13:13,040 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1793475109059110368_1213 terminating
2013-10-31 16:13:13,041 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0019_m_000001_0
2013-10-31 16:13:13,041 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0019_m_000001_0
2013-10-31 16:13:13,042 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1793475109059110368_1213 size 8
2013-10-31 16:13:13,043 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1793475109059110368_1213 size 8
2013-10-31 16:13:13,107 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:13,107 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000001_0 0.0% 
2013-10-31 16:13:13,266 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_1122384754 given task: attempt_20131031160444934_0019_m_000003_0
2013-10-31 16:13:13,267 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_-1452522867 given task: attempt_20131031160444934_0019_m_000004_0
2013-10-31 16:13:13,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split	dst=null	perm=null
2013-10-31 16:13:13,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55278, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8781975787346649086_1206, duration: 168496
2013-10-31 16:13:13,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:13,587 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35243, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 140334
2013-10-31 16:13:13,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:13,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:13,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split	dst=null	perm=null
2013-10-31 16:13:13,779 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35177, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8781975787346649086_1206, duration: 247565
2013-10-31 16:13:13,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split	dst=null	perm=null
2013-10-31 16:13:13,788 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35247, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8781975787346649086_1206, duration: 145161
2013-10-31 16:13:13,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:13,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:13,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:13,818 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48281, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 141143
2013-10-31 16:13:13,820 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55285, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 116262
2013-10-31 16:13:13,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:13,829 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35250, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 106403
2013-10-31 16:13:13,830 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002. blk_-771868539265426080_1214
2013-10-31 16:13:13,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:13,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:13,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:13,853 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-771868539265426080_1214 src: /127.0.0.1:35251 dest: /127.0.0.1:38271
2013-10-31 16:13:13,854 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-771868539265426080_1214 src: /127.0.0.1:35183 dest: /127.0.0.1:50942
2013-10-31 16:13:13,855 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-771868539265426080_1214 src: /127.0.0.1:48286 dest: /127.0.0.1:47311
2013-10-31 16:13:13,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:13,857 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48286, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-771868539265426080_1214, duration: 1034738
2013-10-31 16:13:13,857 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-771868539265426080_1214 terminating
2013-10-31 16:13:13,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35183, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-771868539265426080_1214, duration: 1386086
2013-10-31 16:13:13,858 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-771868539265426080_1214 terminating
2013-10-31 16:13:13,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35251, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-771868539265426080_1214, duration: 1787091
2013-10-31 16:13:13,858 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-771868539265426080_1214 terminating
2013-10-31 16:13:13,858 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-771868539265426080_1214 size 8
2013-10-31 16:13:13,859 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-771868539265426080_1214 size 8
2013-10-31 16:13:13,859 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0019_m_000002_0
2013-10-31 16:13:13,859 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0019_m_000002_0
2013-10-31 16:13:13,859 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-771868539265426080_1214 size 8
2013-10-31 16:13:13,906 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:13,907 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000002_0 0.0% 
2013-10-31 16:13:14,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:14,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:14,066 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55290, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 129634
2013-10-31 16:13:14,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:14,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:14,076 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48288, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 107139
2013-10-31 16:13:14,077 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003. blk_-4539402777667855850_1216
2013-10-31 16:13:14,086 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004. blk_-2121616536547267604_1216
2013-10-31 16:13:14,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4539402777667855850_1216 src: /127.0.0.1:55292 dest: /127.0.0.1:41648
2013-10-31 16:13:14,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4539402777667855850_1216 src: /127.0.0.1:48291 dest: /127.0.0.1:47311
2013-10-31 16:13:14,103 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4539402777667855850_1216 src: /127.0.0.1:35190 dest: /127.0.0.1:50942
2013-10-31 16:13:14,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35190, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4539402777667855850_1216, duration: 1480854
2013-10-31 16:13:14,106 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4539402777667855850_1216 terminating
2013-10-31 16:13:14,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48291, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4539402777667855850_1216, duration: 1740748
2013-10-31 16:13:14,107 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4539402777667855850_1216 terminating
2013-10-31 16:13:14,107 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55292, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4539402777667855850_1216, duration: 2144940
2013-10-31 16:13:14,107 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4539402777667855850_1216 terminating
2013-10-31 16:13:14,108 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4539402777667855850_1216 size 8
2013-10-31 16:13:14,108 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0019_m_000003_0
2013-10-31 16:13:14,109 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0019_m_000003_0
2013-10-31 16:13:14,109 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4539402777667855850_1216 size 8
2013-10-31 16:13:14,110 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2121616536547267604_1216 src: /127.0.0.1:55293 dest: /127.0.0.1:41648
2013-10-31 16:13:14,110 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4539402777667855850_1216 size 8
2013-10-31 16:13:14,112 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2121616536547267604_1216 src: /127.0.0.1:35191 dest: /127.0.0.1:50942
2013-10-31 16:13:14,113 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2121616536547267604_1216 src: /127.0.0.1:48294 dest: /127.0.0.1:47311
2013-10-31 16:13:14,115 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48294, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2121616536547267604_1216, duration: 1608122
2013-10-31 16:13:14,115 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2121616536547267604_1216 terminating
2013-10-31 16:13:14,115 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35191, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2121616536547267604_1216, duration: 1579128
2013-10-31 16:13:14,116 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2121616536547267604_1216 size 8
2013-10-31 16:13:14,116 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2121616536547267604_1216 terminating
2013-10-31 16:13:14,116 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55293, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2121616536547267604_1216, duration: 2395054
2013-10-31 16:13:14,116 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2121616536547267604_1216 terminating
2013-10-31 16:13:14,117 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2121616536547267604_1216 size 8
2013-10-31 16:13:14,118 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0019_m_000004_0
2013-10-31 16:13:14,118 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0019_m_000004_0
2013-10-31 16:13:14,121 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2121616536547267604_1216 size 8
2013-10-31 16:13:14,163 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:14,163 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000003_0 0.0% 
2013-10-31 16:13:14,189 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:14,189 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000004_0 0.0% 
2013-10-31 16:13:14,272 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000000_0
2013-10-31 16:13:14,272 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000001_0
2013-10-31 16:13:14,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0	dst=null	perm=null
2013-10-31 16:13:14,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:14,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:14,940 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000002_0
2013-10-31 16:13:14,940 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000003_0
2013-10-31 16:13:15,091 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000004_0
2013-10-31 16:13:15,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0	dst=null	perm=null
2013-10-31 16:13:15,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0	dst=null	perm=null
2013-10-31 16:13:15,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0	dst=null	perm=null
2013-10-31 16:13:15,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:15,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:15,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:15,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0	dst=null	perm=null
2013-10-31 16:13:15,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:15,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:15,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:15,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0	dst=null	perm=null
2013-10-31 16:13:15,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0	dst=null	perm=null
2013-10-31 16:13:15,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0	dst=null	perm=null
2013-10-31 16:13:15,650 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:13:15,651 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000001_0 is done.
2013-10-31 16:13:15,651 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000001_0  was -1
2013-10-31 16:13:15,652 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:13:15,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0	dst=null	perm=null
2013-10-31 16:13:15,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:15,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:15,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0	dst=null	perm=null
2013-10-31 16:13:16,268 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0019_m_000006_0
2013-10-31 16:13:16,269 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0019_m_000006_0
2013-10-31 16:13:16,269 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000006_0 not found in cache
2013-10-31 16:13:16,473 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:13:16,475 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000002_0 is done.
2013-10-31 16:13:16,475 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000002_0  was -1
2013-10-31 16:13:16,475 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:13:16,702 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:13:16,704 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000004_0 is done.
2013-10-31 16:13:16,704 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000004_0  was -1
2013-10-31 16:13:16,704 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:16,710 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:13:16,711 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000003_0 is done.
2013-10-31 16:13:16,711 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000003_0  was -1
2013-10-31 16:13:16,712 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:17,276 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000001_0' has completed task_20131031160444934_0019_m_000001 successfully.
2013-10-31 16:13:17,481 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:13:17,483 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:13:17,484 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000000_0 is done.
2013-10-31 16:13:17,484 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000000_0  was -1
2013-10-31 16:13:17,484 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:17,944 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000002_0' has completed task_20131031160444934_0019_m_000002 successfully.
2013-10-31 16:13:17,945 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000003_0' has completed task_20131031160444934_0019_m_000003 successfully.
2013-10-31 16:13:18,095 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000004_0' has completed task_20131031160444934_0019_m_000004 successfully.
2013-10-31 16:13:20,281 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000000_0' has completed task_20131031160444934_0019_m_000000 successfully.
2013-10-31 16:13:20,285 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0019_m_000005_0' to tip task_20131031160444934_0019_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:13:20,287 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:13:20,288 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000005_0 which needs 1 slots
2013-10-31 16:13:20,288 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000005_0 which needs 1 slots
2013-10-31 16:13:20,322 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0019/attempt_20131031160444934_0019_m_000005_0. Attempting to reuse: jvm_20131031160444934_0019_m_-1462732907
2013-10-31 16:13:20,712 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_-1462732907 given task: attempt_20131031160444934_0019_m_000005_0
2013-10-31 16:13:20,838 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000005_0 0.0% 
2013-10-31 16:13:20,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary	dst=null	perm=null
2013-10-31 16:13:20,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:20,856 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_SUCCESS from client DFSClient_attempt_20131031160444934_0019_m_000005_0
2013-10-31 16:13:20,857 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0019_m_000005_0
2013-10-31 16:13:20,864 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2795355961709381774 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:20,864 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2795355961709381774 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:20,865 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2795355961709381774 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:20,865 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2795355961709381774 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:20,865 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8781975787346649086 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:20,865 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8781975787346649086 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:20,866 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8781975787346649086 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:20,866 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8781975787346649086 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:20,866 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8067882842254612962 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:20,866 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8067882842254612962 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:20,866 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8067882842254612962 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:20,867 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2067163295264048629 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:20,867 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2067163295264048629 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:20,867 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2067163295264048629 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:20,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019	dst=null	perm=null
2013-10-31 16:13:21,258 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_2067163295264048629_1208 blk_8781975787346649086_1206 blk_-2795355961709381774_1205
2013-10-31 16:13:21,259 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_2067163295264048629_1208 blk_8781975787346649086_1206 blk_-2795355961709381774_1205 blk_8067882842254612962_1207
2013-10-31 16:13:22,008 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2795355961709381774_1205 file build/test/data/dfs/data/data6/current/blk_-2795355961709381774 for deletion
2013-10-31 16:13:22,008 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2067163295264048629_1208 file build/test/data/dfs/data/data6/current/blk_2067163295264048629 for deletion
2013-10-31 16:13:22,008 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8781975787346649086_1206 file build/test/data/dfs/data/data5/current/blk_8781975787346649086 for deletion
2013-10-31 16:13:22,009 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2795355961709381774_1205 at file build/test/data/dfs/data/data6/current/blk_-2795355961709381774
2013-10-31 16:13:22,009 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8781975787346649086_1206 at file build/test/data/dfs/data/data5/current/blk_8781975787346649086
2013-10-31 16:13:22,009 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2067163295264048629_1208 at file build/test/data/dfs/data/data6/current/blk_2067163295264048629
2013-10-31 16:13:23,796 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2795355961709381774_1205 file build/test/data/dfs/data/data2/current/blk_-2795355961709381774 for deletion
2013-10-31 16:13:23,796 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2067163295264048629_1208 file build/test/data/dfs/data/data1/current/blk_2067163295264048629 for deletion
2013-10-31 16:13:23,796 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2795355961709381774_1205 at file build/test/data/dfs/data/data2/current/blk_-2795355961709381774
2013-10-31 16:13:23,796 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8067882842254612962_1207 file build/test/data/dfs/data/data2/current/blk_8067882842254612962 for deletion
2013-10-31 16:13:23,796 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2067163295264048629_1208 at file build/test/data/dfs/data/data1/current/blk_2067163295264048629
2013-10-31 16:13:23,797 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8067882842254612962_1207 at file build/test/data/dfs/data/data2/current/blk_8067882842254612962
2013-10-31 16:13:23,797 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8781975787346649086_1206 file build/test/data/dfs/data/data1/current/blk_8781975787346649086 for deletion
2013-10-31 16:13:23,798 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8781975787346649086_1206 at file build/test/data/dfs/data/data1/current/blk_8781975787346649086
2013-10-31 16:13:23,808 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000005_0 0.0% cleanup
2013-10-31 16:13:23,809 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000005_0 is done.
2013-10-31 16:13:23,810 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000005_0  was -1
2013-10-31 16:13:23,810 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:24,259 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_8781975787346649086_1206 blk_-2795355961709381774_1205 blk_8067882842254612962_1207
2013-10-31 16:13:24,260 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_2067163295264048629_1208 blk_8781975787346649086_1206 blk_-2795355961709381774_1205 blk_8067882842254612962_1207
2013-10-31 16:13:24,396 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2795355961709381774_1205 file build/test/data/dfs/data/data4/current/blk_-2795355961709381774 for deletion
2013-10-31 16:13:24,396 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8067882842254612962_1207 file build/test/data/dfs/data/data4/current/blk_8067882842254612962 for deletion
2013-10-31 16:13:24,396 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2795355961709381774_1205 at file build/test/data/dfs/data/data4/current/blk_-2795355961709381774
2013-10-31 16:13:24,396 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8781975787346649086_1206 file build/test/data/dfs/data/data3/current/blk_8781975787346649086 for deletion
2013-10-31 16:13:24,397 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8067882842254612962_1207 at file build/test/data/dfs/data/data4/current/blk_8067882842254612962
2013-10-31 16:13:24,397 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8781975787346649086_1206 at file build/test/data/dfs/data/data3/current/blk_8781975787346649086
2013-10-31 16:13:26,002 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 47
2013-10-31 16:13:26,294 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000005_0' has completed task_20131031160444934_0019_m_000005 successfully.
2013-10-31 16:13:26,295 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0019 has completed successfully.
2013-10-31 16:13:26,296 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0019,submitTime=1383235983628,launchTime=1383235983738,firstMapTaskLaunchTime=1383235991263,firstJobSetupTaskLaunchTime=1383235985247,firstJobCleanupTaskLaunchTime=1383236000285,finishTime=1383236006295,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[8A2953BF1D3A446B80609784D024760C/C501A264995C4077B7A72D7D1F16C4D0] lower*upper/(1/1) ...ldedpipesplatform/unknown
2013-10-31 16:13:26,303 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077. blk_-121103666218840297_1217
2013-10-31 16:13:26,305 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-121103666218840297_1217 src: /127.0.0.1:35264 dest: /127.0.0.1:38271
2013-10-31 16:13:26,307 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-121103666218840297_1217 src: /127.0.0.1:55301 dest: /127.0.0.1:41648
2013-10-31 16:13:26,309 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-121103666218840297_1217 src: /127.0.0.1:48299 dest: /127.0.0.1:47311
2013-10-31 16:13:26,318 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48299, dest: /127.0.0.1:47311, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-121103666218840297_1217, duration: 5092954
2013-10-31 16:13:26,319 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-121103666218840297_1217 terminating
2013-10-31 16:13:26,319 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55301, dest: /127.0.0.1:41648, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-121103666218840297_1217, duration: 3631671
2013-10-31 16:13:26,320 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-121103666218840297_1217 terminating
2013-10-31 16:13:26,320 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-121103666218840297_1217 size 26335
2013-10-31 16:13:26,320 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35264, dest: /127.0.0.1:38271, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-121103666218840297_1217, duration: 7305510
2013-10-31 16:13:26,321 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-121103666218840297_1217 terminating
2013-10-31 16:13:26,325 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-121103666218840297_1217 size 26335
2013-10-31 16:13:26,325 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077 from client DFSClient_-1583062373
2013-10-31 16:13:26,325 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077 is closed by DFSClient_-1583062373
2013-10-31 16:13:26,326 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-121103666218840297_1217 size 26335
2013-10-31 16:13:26,333 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:26,334 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000000_0'
2013-10-31 16:13:26,334 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000001_0'
2013-10-31 16:13:26,335 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000005_0'
2013-10-31 16:13:26,335 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000006_0'
2013-10-31 16:13:26,335 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5892293765468690806 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:26,336 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5892293765468690806 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:26,336 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5892293765468690806 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:26,339 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0019_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:26,343 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary
2013-10-31 16:13:26,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019	dst=null	perm=null
2013-10-31 16:13:26,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown	dst=null	perm=null
2013-10-31 16:13:26,402 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:13:26,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2013-10-31 16:13:26,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2013-10-31 16:13:26,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2013-10-31 16:13:26,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2013-10-31 16:13:26,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2013-10-31 16:13:26,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2013-10-31 16:13:26,413 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55304, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1978869255100246022_1212, duration: 284672
2013-10-31 16:13:26,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2013-10-31 16:13:26,416 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48302, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1793475109059110368_1213, duration: 256122
2013-10-31 16:13:26,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2013-10-31 16:13:26,419 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35201, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-771868539265426080_1214, duration: 256677
2013-10-31 16:13:26,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2013-10-31 16:13:26,422 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35202, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4539402777667855850_1216, duration: 257253
2013-10-31 16:13:26,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2013-10-31 16:13:26,425 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35203, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2121616536547267604_1216, duration: 247491
2013-10-31 16:13:26,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown	dst=null	perm=null
2013-10-31 16:13:26,443 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:13:26,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2013-10-31 16:13:26,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2013-10-31 16:13:26,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2013-10-31 16:13:26,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2013-10-31 16:13:26,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2013-10-31 16:13:26,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2013-10-31 16:13:26,453 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35204, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1978869255100246022_1212, duration: 282222
2013-10-31 16:13:26,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2013-10-31 16:13:26,456 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48307, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1793475109059110368_1213, duration: 262167
2013-10-31 16:13:26,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2013-10-31 16:13:26,459 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35275, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-771868539265426080_1214, duration: 263150
2013-10-31 16:13:26,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2013-10-31 16:13:26,462 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35207, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4539402777667855850_1216, duration: 266068
2013-10-31 16:13:26,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2013-10-31 16:13:26,465 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55313, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2121616536547267604_1216, duration: 263850
2013-10-31 16:13:26,465 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/unknown
2013-10-31 16:13:26,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown	dst=null	perm=null
2013-10-31 16:13:26,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2013-10-31 16:13:26,474 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55314, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1978869255100246022_1212, duration: 258729
2013-10-31 16:13:26,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2013-10-31 16:13:26,478 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35210, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1793475109059110368_1213, duration: 260392
2013-10-31 16:13:26,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2013-10-31 16:13:26,482 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35280, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-771868539265426080_1214, duration: 264513
2013-10-31 16:13:26,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2013-10-31 16:13:26,486 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35212, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4539402777667855850_1216, duration: 261739
2013-10-31 16:13:26,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2013-10-31 16:13:26,490 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48315, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2121616536547267604_1216, duration: 252597
2013-10-31 16:13:26,511 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:13:26,512 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:13:26,534 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] starting
2013-10-31 16:13:26,534 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:13:26,535 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:13:26,535 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:13:26,535 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost"]
2013-10-31 16:13:26,536 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  parallel execution is enabled: true
2013-10-31 16:13:26,536 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  starting jobs: 1
2013-10-31 16:13:26,536 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  allocating threads: 1
2013-10-31 16:13:26,538 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] starting step: (1/1) ...m/joinaroundjoinrightmost
2013-10-31 16:13:26,542 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:13:26,542 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:13:26,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:26,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:13:26,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:26,565 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar. blk_-4227185307943247060_1218
2013-10-31 16:13:26,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4227185307943247060_1218 src: /127.0.0.1:48316 dest: /127.0.0.1:47311
2013-10-31 16:13:26,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4227185307943247060_1218 src: /127.0.0.1:35215 dest: /127.0.0.1:50942
2013-10-31 16:13:26,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4227185307943247060_1218 src: /127.0.0.1:55321 dest: /127.0.0.1:41648
2013-10-31 16:13:26,578 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55321, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4227185307943247060_1218, duration: 4009287
2013-10-31 16:13:26,578 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4227185307943247060_1218 size 238055
2013-10-31 16:13:26,578 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4227185307943247060_1218 terminating
2013-10-31 16:13:26,579 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35215, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4227185307943247060_1218, duration: 5148434
2013-10-31 16:13:26,579 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4227185307943247060_1218 terminating
2013-10-31 16:13:26,580 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48316, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4227185307943247060_1218, duration: 6068084
2013-10-31 16:13:26,580 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4227185307943247060_1218 terminating
2013-10-31 16:13:26,582 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4227185307943247060_1218 size 238055
2013-10-31 16:13:26,582 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar from client DFSClient_1457307213
2013-10-31 16:13:26,583 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar is closed by DFSClient_1457307213
2013-10-31 16:13:26,583 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4227185307943247060_1218 size 238055
2013-10-31 16:13:26,956 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000002_0'
2013-10-31 16:13:26,957 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000003_0'
2013-10-31 16:13:27,000 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2795355961709381774_1205 file build/test/data/dfs/data/data8/current/blk_-2795355961709381774 for deletion
2013-10-31 16:13:27,000 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2067163295264048629_1208 file build/test/data/dfs/data/data7/current/blk_2067163295264048629 for deletion
2013-10-31 16:13:27,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8067882842254612962_1207 file build/test/data/dfs/data/data8/current/blk_8067882842254612962 for deletion
2013-10-31 16:13:27,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2067163295264048629_1208 at file build/test/data/dfs/data/data7/current/blk_2067163295264048629
2013-10-31 16:13:27,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8781975787346649086_1206 file build/test/data/dfs/data/data7/current/blk_8781975787346649086 for deletion
2013-10-31 16:13:27,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2795355961709381774_1205 at file build/test/data/dfs/data/data8/current/blk_-2795355961709381774
2013-10-31 16:13:27,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8781975787346649086_1206 at file build/test/data/dfs/data/data7/current/blk_8781975787346649086
2013-10-31 16:13:27,002 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8067882842254612962_1207 at file build/test/data/dfs/data/data8/current/blk_8067882842254612962
2013-10-31 16:13:27,107 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000004_0'
2013-10-31 16:13:27,112 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0019
2013-10-31 16:13:27,113 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0019 being deleted.
2013-10-31 16:13:27,260 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-5892293765468690806_1211
2013-10-31 16:13:27,260 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-5892293765468690806_1211
2013-10-31 16:13:27,397 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5892293765468690806_1211 file build/test/data/dfs/data/data4/current/blk_-5892293765468690806 for deletion
2013-10-31 16:13:27,397 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5892293765468690806_1211 at file build/test/data/dfs/data/data4/current/blk_-5892293765468690806
2013-10-31 16:13:27,732 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar. New replication is 10
2013-10-31 16:13:27,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar	dst=null	perm=null
2013-10-31 16:13:27,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,745 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:13:27,750 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:27,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:27,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,763 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split. New replication is 10
2013-10-31 16:13:27,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split	dst=null	perm=null
2013-10-31 16:13:27,769 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split. blk_-4109011025327673168_1219
2013-10-31 16:13:27,771 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4109011025327673168_1219 src: /127.0.0.1:35217 dest: /127.0.0.1:50942
2013-10-31 16:13:27,773 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4109011025327673168_1219 src: /127.0.0.1:55323 dest: /127.0.0.1:41648
2013-10-31 16:13:27,774 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4109011025327673168_1219 src: /127.0.0.1:48321 dest: /127.0.0.1:47311
2013-10-31 16:13:27,776 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4109011025327673168_1219 src: /127.0.0.1:35289 dest: /127.0.0.1:38271
2013-10-31 16:13:27,779 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35289, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4109011025327673168_1219, duration: 111517
2013-10-31 16:13:27,780 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4109011025327673168_1219 terminating
2013-10-31 16:13:27,780 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48321, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4109011025327673168_1219, duration: 945271
2013-10-31 16:13:27,781 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4109011025327673168_1219 terminating
2013-10-31 16:13:27,781 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4109011025327673168_1219 size 1732
2013-10-31 16:13:27,781 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55323, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4109011025327673168_1219, duration: 2067317
2013-10-31 16:13:27,782 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4109011025327673168_1219 size 1732
2013-10-31 16:13:27,782 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4109011025327673168_1219 terminating
2013-10-31 16:13:27,783 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35217, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4109011025327673168_1219, duration: 3403927
2013-10-31 16:13:27,783 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-4109011025327673168_1219 terminating
2013-10-31 16:13:27,786 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4109011025327673168_1219 size 1732
2013-10-31 16:13:27,786 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split from client DFSClient_1457307213
2013-10-31 16:13:27,787 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split is closed by DFSClient_1457307213
2013-10-31 16:13:27,787 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4109011025327673168_1219 size 1732
2013-10-31 16:13:27,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,807 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo. blk_2391612123643840912_1220
2013-10-31 16:13:27,809 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2391612123643840912_1220 src: /127.0.0.1:55326 dest: /127.0.0.1:41648
2013-10-31 16:13:27,810 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2391612123643840912_1220 src: /127.0.0.1:35291 dest: /127.0.0.1:38271
2013-10-31 16:13:27,812 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2391612123643840912_1220 src: /127.0.0.1:35223 dest: /127.0.0.1:50942
2013-10-31 16:13:27,815 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35223, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2391612123643840912_1220, duration: 67851
2013-10-31 16:13:27,815 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2391612123643840912_1220 terminating
2013-10-31 16:13:27,816 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35291, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2391612123643840912_1220, duration: 953127
2013-10-31 16:13:27,816 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2391612123643840912_1220 terminating
2013-10-31 16:13:27,817 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55326, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2391612123643840912_1220, duration: 1945799
2013-10-31 16:13:27,817 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2391612123643840912_1220 terminating
2013-10-31 16:13:27,818 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2391612123643840912_1220 size 183
2013-10-31 16:13:27,819 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:13:27,820 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:13:27,820 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2391612123643840912_1220 size 183
2013-10-31 16:13:27,820 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2391612123643840912_1220 size 183
2013-10-31 16:13:27,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,846 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml. blk_218933756069317154_1221
2013-10-31 16:13:27,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_218933756069317154_1221 src: /127.0.0.1:48326 dest: /127.0.0.1:47311
2013-10-31 16:13:27,850 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_218933756069317154_1221 src: /127.0.0.1:35225 dest: /127.0.0.1:50942
2013-10-31 16:13:27,851 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_218933756069317154_1221 src: /127.0.0.1:35295 dest: /127.0.0.1:38271
2013-10-31 16:13:27,854 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35295, dest: /127.0.0.1:38271, bytes: 28680, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_218933756069317154_1221, duration: 60155
2013-10-31 16:13:27,854 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_218933756069317154_1221 terminating
2013-10-31 16:13:27,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35225, dest: /127.0.0.1:50942, bytes: 28680, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_218933756069317154_1221, duration: 762755
2013-10-31 16:13:27,855 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_218933756069317154_1221 terminating
2013-10-31 16:13:27,856 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48326, dest: /127.0.0.1:47311, bytes: 28680, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_218933756069317154_1221, duration: 1685916
2013-10-31 16:13:27,856 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_218933756069317154_1221 terminating
2013-10-31 16:13:27,858 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_218933756069317154_1221 size 28680
2013-10-31 16:13:27,858 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_218933756069317154_1221 size 28680
2013-10-31 16:13:27,859 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml from client DFSClient_1457307213
2013-10-31 16:13:27,859 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml is closed by DFSClient_1457307213
2013-10-31 16:13:27,859 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_218933756069317154_1221 size 28680
2013-10-31 16:13:27,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml	dst=null	perm=null
2013-10-31 16:13:27,873 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35297, bytes: 28908, op: HDFS_READ, cliID: DFSClient_642840985, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_218933756069317154_1221, duration: 400625
2013-10-31 16:13:27,893 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0020: nMaps=5 nReduces=0 max=-1
2013-10-31 16:13:27,893 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0020 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:13:27,893 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0020
2013-10-31 16:13:27,893 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0020	RESULT=SUCCESS
2013-10-31 16:13:27,893 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0020
2013-10-31 16:13:27,895 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] submitted hadoop job: job_20131031160444934_0020
2013-10-31 16:13:27,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,927 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_conf.xml. blk_3666268837730504544_1223
2013-10-31 16:13:27,929 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3666268837730504544_1223 src: /127.0.0.1:35229 dest: /127.0.0.1:50942
2013-10-31 16:13:27,931 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3666268837730504544_1223 src: /127.0.0.1:48332 dest: /127.0.0.1:47311
2013-10-31 16:13:27,933 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3666268837730504544_1223 src: /127.0.0.1:55336 dest: /127.0.0.1:41648
2013-10-31 16:13:27,936 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55336, dest: /127.0.0.1:41648, bytes: 28745, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3666268837730504544_1223, duration: 605550
2013-10-31 16:13:27,937 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3666268837730504544_1223 terminating
2013-10-31 16:13:27,937 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48332, dest: /127.0.0.1:47311, bytes: 28745, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3666268837730504544_1223, duration: 1719361
2013-10-31 16:13:27,938 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3666268837730504544_1223 terminating
2013-10-31 16:13:27,938 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3666268837730504544_1223 size 28745
2013-10-31 16:13:27,938 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35229, dest: /127.0.0.1:50942, bytes: 28745, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3666268837730504544_1223, duration: 2265470
2013-10-31 16:13:27,939 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3666268837730504544_1223 terminating
2013-10-31 16:13:27,941 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3666268837730504544_1223 size 28745
2013-10-31 16:13:27,942 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_conf.xml from client DFSClient_642840985
2013-10-31 16:13:27,942 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_conf.xml is closed by DFSClient_642840985
2013-10-31 16:13:27,943 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3666268837730504544_1223 size 28745
2013-10-31 16:13:29,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:29,056 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken. blk_295404966245382265_1224
2013-10-31 16:13:29,058 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295404966245382265_1224 src: /127.0.0.1:55337 dest: /127.0.0.1:41648
2013-10-31 16:13:29,059 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295404966245382265_1224 src: /127.0.0.1:35302 dest: /127.0.0.1:38271
2013-10-31 16:13:29,061 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295404966245382265_1224 src: /127.0.0.1:48336 dest: /127.0.0.1:47311
2013-10-31 16:13:29,064 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48336, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_295404966245382265_1224, duration: 65414
2013-10-31 16:13:29,064 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_295404966245382265_1224 terminating
2013-10-31 16:13:29,065 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35302, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_295404966245382265_1224, duration: 825959
2013-10-31 16:13:29,065 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_295404966245382265_1224 terminating
2013-10-31 16:13:29,066 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55337, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_295404966245382265_1224, duration: 1820653
2013-10-31 16:13:29,067 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_295404966245382265_1224 terminating
2013-10-31 16:13:29,069 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_295404966245382265_1224 size 116
2013-10-31 16:13:29,069 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_295404966245382265_1224 size 116
2013-10-31 16:13:29,070 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_295404966245382265_1224 size 116
2013-10-31 16:13:29,469 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken from client DFSClient_1457307213
2013-10-31 16:13:29,470 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken is closed by DFSClient_1457307213
2013-10-31 16:13:29,477 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken
2013-10-31 16:13:29,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:13:29,481 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35235, bytes: 187, op: HDFS_READ, cliID: DFSClient_642840985, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2391612123643840912_1220, duration: 275092
2013-10-31 16:13:29,482 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0020 = 19. Number of splits = 5
2013-10-31 16:13:29,483 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,483 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,483 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,483 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,485 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,485 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,485 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,485 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,486 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,486 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,486 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0020 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:13:29,487 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0020 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:13:29,963 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0020_m_000006_0' to tip task_20131031160444934_0020_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:29,973 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:13:29,974 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000006_0 which needs 1 slots
2013-10-31 16:13:29,974 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000006_0 which needs 1 slots
2013-10-31 16:13:29,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken	dst=null	perm=null
2013-10-31 16:13:29,982 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48338, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_295404966245382265_1224, duration: 304139
2013-10-31 16:13:29,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml	dst=null	perm=null
2013-10-31 16:13:29,992 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48340, bytes: 28908, op: HDFS_READ, cliID: DFSClient_1413368305, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_218933756069317154_1221, duration: 385962
2013-10-31 16:13:30,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5892293765468690806_1211 file build/test/data/dfs/data/data7/current/blk_-5892293765468690806 for deletion
2013-10-31 16:13:30,001 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5892293765468690806_1211 at file build/test/data/dfs/data/data7/current/blk_-5892293765468690806
2013-10-31 16:13:30,023 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:30,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar	dst=null	perm=null
2013-10-31 16:13:30,057 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35239, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1413368305, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4227185307943247060_1218, duration: 1060215
2013-10-31 16:13:30,132 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0019_m_1122384754
2013-10-31 16:13:30,136 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21315 with signal TERM. Exit code 0
2013-10-31 16:13:30,136 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_-1766447982
2013-10-31 16:13:30,137 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_-1766447982 spawned.
2013-10-31 16:13:30,138 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000006_0/taskjvm.sh
2013-10-31 16:13:30,204 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:30,204 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:30,204 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:30,204 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_1122384754 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:30,261 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-4227185307943247060_1218 to datanode(s) 127.0.0.1:38271
2013-10-31 16:13:30,261 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5892293765468690806_1211
2013-10-31 16:13:30,398 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-4227185307943247060_1218 to 127.0.0.1:38271 
2013-10-31 16:13:30,400 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4227185307943247060_1218 src: /127.0.0.1:35309 dest: /127.0.0.1:38271
2013-10-31 16:13:30,400 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-4227185307943247060_1218 to /127.0.0.1:38271
2013-10-31 16:13:30,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4227185307943247060_1218 src: /127.0.0.1:35309 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:13:30,406 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4227185307943247060_1218 size 238055
2013-10-31 16:13:31,336 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0019
2013-10-31 16:13:31,337 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000005_0 not found in cache
2013-10-31 16:13:31,337 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000001_0 not found in cache
2013-10-31 16:13:31,337 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000000_0 not found in cache
2013-10-31 16:13:31,338 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0019 for user-log deletion with retainTimeStamp:1383322411338
2013-10-31 16:13:31,372 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_-1766447982 given task: attempt_20131031160444934_0020_m_000006_0
2013-10-31 16:13:31,524 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0019_m_226989341 since job job_20131031160444934_0019 is dead
2013-10-31 16:13:31,528 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21023 with signal TERM. Exit code 0
2013-10-31 16:13:31,689 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:31,689 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:31,689 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:31,689 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_226989341 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:13:31,847 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0019_m_-1462732907 since job job_20131031160444934_0019 is dead
2013-10-31 16:13:31,851 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21180 with signal TERM. Exit code 0
2013-10-31 16:13:31,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:31,957 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0019
2013-10-31 16:13:31,958 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000002_0 not found in cache
2013-10-31 16:13:31,958 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000003_0 not found in cache
2013-10-31 16:13:31,959 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0019 for user-log deletion with retainTimeStamp:1383322411958
2013-10-31 16:13:32,001 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:32,001 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:32,001 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:32,001 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_-1462732907 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:13:32,043 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0019_m_235871377 since job job_20131031160444934_0019 is dead
2013-10-31 16:13:32,053 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21277 with signal TERM. Exit code 0
2013-10-31 16:13:32,107 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0019
2013-10-31 16:13:32,108 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000004_0 not found in cache
2013-10-31 16:13:32,109 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0019 for user-log deletion with retainTimeStamp:1383322412108
2013-10-31 16:13:32,240 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:32,240 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:32,240 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:32,240 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_235871377 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:32,264 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0019_m_-1452522867 since job job_20131031160444934_0019 is dead
2013-10-31 16:13:32,273 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21314 with signal TERM. Exit code 0
2013-10-31 16:13:32,476 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:32,476 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:32,476 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:32,477 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_-1452522867 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:32,799 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5892293765468690806_1211 file build/test/data/dfs/data/data1/current/blk_-5892293765468690806 for deletion
2013-10-31 16:13:32,799 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5892293765468690806_1211 at file build/test/data/dfs/data/data1/current/blk_-5892293765468690806
2013-10-31 16:13:34,807 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000006_0 0.0% setup
2013-10-31 16:13:34,810 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000006_0 is done.
2013-10-31 16:13:34,810 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000006_0  was -1
2013-10-31 16:13:34,811 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:35,979 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000006_0' has completed task_20131031160444934_0020_m_000006 successfully.
2013-10-31 16:13:35,984 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000000_0' to tip task_20131031160444934_0020_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:35,987 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000000
2013-10-31 16:13:35,987 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000001_0' to tip task_20131031160444934_0020_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:35,987 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000001
2013-10-31 16:13:35,989 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:13:35,990 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:13:35,991 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000000_0 which needs 1 slots
2013-10-31 16:13:35,991 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000000_0 which needs 1 slots
2013-10-31 16:13:35,991 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000001_0 which needs 1 slots
2013-10-31 16:13:35,992 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0020_m_000001_0 which needs 1 slots
2013-10-31 16:13:36,026 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_1620994915
2013-10-31 16:13:36,027 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_1620994915 spawned.
2013-10-31 16:13:36,028 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0020/attempt_20131031160444934_0020_m_000001_0. Attempting to reuse: jvm_20131031160444934_0020_m_-1766447982
2013-10-31 16:13:36,030 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000000_0/taskjvm.sh
2013-10-31 16:13:36,120 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000002_0' to tip task_20131031160444934_0020_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:13:36,120 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000002
2013-10-31 16:13:36,120 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000003_0' to tip task_20131031160444934_0020_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:13:36,121 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000003
2013-10-31 16:13:36,122 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:13:36,122 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:13:36,123 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000004_0' to tip task_20131031160444934_0020_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:13:36,123 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000002_0 which needs 1 slots
2013-10-31 16:13:36,123 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000004
2013-10-31 16:13:36,123 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000002_0 which needs 1 slots
2013-10-31 16:13:36,124 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000003_0 which needs 1 slots
2013-10-31 16:13:36,124 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:13:36,125 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0020_m_000003_0 which needs 1 slots
2013-10-31 16:13:36,125 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000004_0 which needs 1 slots
2013-10-31 16:13:36,125 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000004_0 which needs 1 slots
2013-10-31 16:13:36,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken	dst=null	perm=null
2013-10-31 16:13:36,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken	dst=null	perm=null
2013-10-31 16:13:36,131 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55353, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_295404966245382265_1224, duration: 131188
2013-10-31 16:13:36,131 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35316, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_295404966245382265_1224, duration: 303733
2013-10-31 16:13:36,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml	dst=null	perm=null
2013-10-31 16:13:36,139 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35251, bytes: 28908, op: HDFS_READ, cliID: DFSClient_-853586302, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_218933756069317154_1221, duration: 171636
2013-10-31 16:13:36,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml	dst=null	perm=null
2013-10-31 16:13:36,142 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35252, bytes: 28908, op: HDFS_READ, cliID: DFSClient_-736712462, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_218933756069317154_1221, duration: 375260
2013-10-31 16:13:36,157 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:36,165 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:36,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar	dst=null	perm=null
2013-10-31 16:13:36,172 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35253, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-853586302, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4227185307943247060_1218, duration: 660010
2013-10-31 16:13:36,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar	dst=null	perm=null
2013-10-31 16:13:36,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35323, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-736712462, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4227185307943247060_1218, duration: 653575
2013-10-31 16:13:36,228 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_-114402403
2013-10-31 16:13:36,228 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_-114402403 spawned.
2013-10-31 16:13:36,230 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000004_0/taskjvm.sh
2013-10-31 16:13:36,237 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_2133656262
2013-10-31 16:13:36,237 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_2133656262 spawned.
2013-10-31 16:13:36,237 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_1147863550
2013-10-31 16:13:36,238 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_1147863550 spawned.
2013-10-31 16:13:36,239 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000003_0/taskjvm.sh
2013-10-31 16:13:36,239 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000002_0/taskjvm.sh
2013-10-31 16:13:36,368 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_-1766447982 given task: attempt_20131031160444934_0020_m_000001_0
2013-10-31 16:13:36,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split	dst=null	perm=null
2013-10-31 16:13:36,488 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35256, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4109011025327673168_1219, duration: 169849
2013-10-31 16:13:36,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:36,529 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35257, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 118743
2013-10-31 16:13:36,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:36,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:36,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:36,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:36,861 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48361, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 283877
2013-10-31 16:13:36,872 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001. blk_4251397641509719279_1225
2013-10-31 16:13:36,890 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4251397641509719279_1225 src: /127.0.0.1:35329 dest: /127.0.0.1:38271
2013-10-31 16:13:36,891 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4251397641509719279_1225 src: /127.0.0.1:55366 dest: /127.0.0.1:41648
2013-10-31 16:13:36,892 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4251397641509719279_1225 src: /127.0.0.1:35262 dest: /127.0.0.1:50942
2013-10-31 16:13:36,894 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35262, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4251397641509719279_1225, duration: 1372907
2013-10-31 16:13:36,894 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4251397641509719279_1225 terminating
2013-10-31 16:13:36,894 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55366, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4251397641509719279_1225, duration: 1647295
2013-10-31 16:13:36,895 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4251397641509719279_1225 terminating
2013-10-31 16:13:36,895 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35329, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4251397641509719279_1225, duration: 2087650
2013-10-31 16:13:36,895 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4251397641509719279_1225 terminating
2013-10-31 16:13:36,895 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4251397641509719279_1225 size 12
2013-10-31 16:13:36,896 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4251397641509719279_1225 size 12
2013-10-31 16:13:36,897 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4251397641509719279_1225 size 12
2013-10-31 16:13:36,897 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0020_m_000001_0
2013-10-31 16:13:36,897 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0020_m_000001_0
2013-10-31 16:13:36,921 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_1620994915 given task: attempt_20131031160444934_0020_m_000000_0
2013-10-31 16:13:36,935 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:36,935 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000001_0 0.0% 
2013-10-31 16:13:37,386 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_-114402403 given task: attempt_20131031160444934_0020_m_000004_0
2013-10-31 16:13:37,403 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_1147863550 given task: attempt_20131031160444934_0020_m_000002_0
2013-10-31 16:13:37,415 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_2133656262 given task: attempt_20131031160444934_0020_m_000003_0
2013-10-31 16:13:37,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split	dst=null	perm=null
2013-10-31 16:13:37,441 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35336, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4109011025327673168_1219, duration: 167749
2013-10-31 16:13:37,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:37,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:37,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:37,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:37,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:37,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55373, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 162860
2013-10-31 16:13:37,730 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48371, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 116619
2013-10-31 16:13:37,739 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000. blk_-4005825571142535716_1226
2013-10-31 16:13:37,773 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4005825571142535716_1226 src: /127.0.0.1:35339 dest: /127.0.0.1:38271
2013-10-31 16:13:37,774 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4005825571142535716_1226 src: /127.0.0.1:55376 dest: /127.0.0.1:41648
2013-10-31 16:13:37,775 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4005825571142535716_1226 src: /127.0.0.1:35272 dest: /127.0.0.1:50942
2013-10-31 16:13:37,777 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35272, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4005825571142535716_1226, duration: 1224644
2013-10-31 16:13:37,777 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4005825571142535716_1226 terminating
2013-10-31 16:13:37,777 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55376, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4005825571142535716_1226, duration: 1599159
2013-10-31 16:13:37,778 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4005825571142535716_1226 terminating
2013-10-31 16:13:37,778 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35339, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4005825571142535716_1226, duration: 1986038
2013-10-31 16:13:37,778 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4005825571142535716_1226 terminating
2013-10-31 16:13:37,778 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4005825571142535716_1226 size 12
2013-10-31 16:13:37,779 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0020_m_000000_0
2013-10-31 16:13:37,779 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0020_m_000000_0
2013-10-31 16:13:37,780 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4005825571142535716_1226 size 12
2013-10-31 16:13:37,780 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4005825571142535716_1226 size 12
2013-10-31 16:13:37,829 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:37,829 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000000_0 0.0% 
2013-10-31 16:13:37,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split	dst=null	perm=null
2013-10-31 16:13:37,888 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35345, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4109011025327673168_1219, duration: 173568
2013-10-31 16:13:37,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split	dst=null	perm=null
2013-10-31 16:13:37,916 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48379, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4109011025327673168_1219, duration: 168259
2013-10-31 16:13:37,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:37,927 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35278, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 105747
2013-10-31 16:13:37,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split	dst=null	perm=null
2013-10-31 16:13:37,936 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35348, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4109011025327673168_1219, duration: 145222
2013-10-31 16:13:37,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:37,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:37,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:37,956 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35280, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 112586
2013-10-31 16:13:37,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:37,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:37,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:37,976 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48383, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 107012
2013-10-31 16:13:37,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:37,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:38,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:38,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:38,164 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48384, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 144682
2013-10-31 16:13:38,175 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004. blk_2906097007668293649_1229
2013-10-31 16:13:38,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:38,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:38,191 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35284, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 188785
2013-10-31 16:13:38,201 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2906097007668293649_1229 src: /127.0.0.1:35352 dest: /127.0.0.1:38271
2013-10-31 16:13:38,202 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002. blk_3264818105380341287_1229
2013-10-31 16:13:38,202 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2906097007668293649_1229 src: /127.0.0.1:35285 dest: /127.0.0.1:50942
2013-10-31 16:13:38,203 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2906097007668293649_1229 src: /127.0.0.1:48389 dest: /127.0.0.1:47311
2013-10-31 16:13:38,206 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48389, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2906097007668293649_1229, duration: 1652633
2013-10-31 16:13:38,206 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2906097007668293649_1229 terminating
2013-10-31 16:13:38,206 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35285, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2906097007668293649_1229, duration: 2039142
2013-10-31 16:13:38,206 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2906097007668293649_1229 terminating
2013-10-31 16:13:38,206 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35352, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2906097007668293649_1229, duration: 2386188
2013-10-31 16:13:38,207 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2906097007668293649_1229 terminating
2013-10-31 16:13:38,209 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2906097007668293649_1229 size 12
2013-10-31 16:13:38,209 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0020_m_000004_0
2013-10-31 16:13:38,209 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0020_m_000004_0
2013-10-31 16:13:38,209 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2906097007668293649_1229 size 12
2013-10-31 16:13:38,211 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2906097007668293649_1229 size 12
2013-10-31 16:13:38,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:38,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:13:38,226 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3264818105380341287_1229 src: /127.0.0.1:35286 dest: /127.0.0.1:50942
2013-10-31 16:13:38,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3264818105380341287_1229 src: /127.0.0.1:35357 dest: /127.0.0.1:38271
2013-10-31 16:13:38,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3264818105380341287_1229 src: /127.0.0.1:55395 dest: /127.0.0.1:41648
2013-10-31 16:13:38,228 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35289, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 120594
2013-10-31 16:13:38,229 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55395, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3264818105380341287_1229, duration: 796905
2013-10-31 16:13:38,230 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3264818105380341287_1229 terminating
2013-10-31 16:13:38,230 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35357, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3264818105380341287_1229, duration: 1156390
2013-10-31 16:13:38,230 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3264818105380341287_1229 terminating
2013-10-31 16:13:38,230 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35286, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3264818105380341287_1229, duration: 1494236
2013-10-31 16:13:38,231 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3264818105380341287_1229 terminating
2013-10-31 16:13:38,232 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3264818105380341287_1229 size 12
2013-10-31 16:13:38,233 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3264818105380341287_1229 size 12
2013-10-31 16:13:38,234 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3264818105380341287_1229 size 12
2013-10-31 16:13:38,632 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0020_m_000002_0
2013-10-31 16:13:38,633 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0020_m_000002_0
2013-10-31 16:13:38,740 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003. blk_-1698530720272675639_1229
2013-10-31 16:13:38,773 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1698530720272675639_1229 src: /127.0.0.1:55396 dest: /127.0.0.1:41648
2013-10-31 16:13:38,798 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1698530720272675639_1229 src: /127.0.0.1:35292 dest: /127.0.0.1:50942
2013-10-31 16:13:38,800 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1698530720272675639_1229 src: /127.0.0.1:35362 dest: /127.0.0.1:38271
2013-10-31 16:13:38,805 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35362, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1698530720272675639_1229, duration: 2311191
2013-10-31 16:13:38,805 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1698530720272675639_1229 terminating
2013-10-31 16:13:38,806 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35292, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1698530720272675639_1229, duration: 3092888
2013-10-31 16:13:38,806 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1698530720272675639_1229 terminating
2013-10-31 16:13:38,806 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1698530720272675639_1229 size 12
2013-10-31 16:13:38,806 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55396, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1698530720272675639_1229, duration: 3917964
2013-10-31 16:13:38,807 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1698530720272675639_1229 size 12
2013-10-31 16:13:38,807 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1698530720272675639_1229 terminating
2013-10-31 16:13:38,808 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1698530720272675639_1229 size 12
2013-10-31 16:13:38,809 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0020_m_000003_0
2013-10-31 16:13:38,810 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0020_m_000003_0
2013-10-31 16:13:38,951 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:38,951 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000004_0 0.0% 
2013-10-31 16:13:38,952 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:38,952 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000003_0 0.0% 
2013-10-31 16:13:38,952 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:38,952 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000002_0 0.0% 
2013-10-31 16:13:38,995 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000000_0
2013-10-31 16:13:38,995 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000001_0
2013-10-31 16:13:39,126 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000002_0
2013-10-31 16:13:39,127 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000003_0
2013-10-31 16:13:39,128 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000004_0
2013-10-31 16:13:39,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0	dst=null	perm=null
2013-10-31 16:13:39,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,848 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:13:39,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,860 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0	dst=null	perm=null
2013-10-31 16:13:39,866 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,871 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,876 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,882 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,887 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,887 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:13:39,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0	dst=null	perm=null
2013-10-31 16:13:39,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0	dst=null	perm=null
2013-10-31 16:13:39,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0	dst=null	perm=null
2013-10-31 16:13:39,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0	dst=null	perm=null
2013-10-31 16:13:39,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0	dst=null	perm=null
2013-10-31 16:13:39,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0	dst=null	perm=null
2013-10-31 16:13:39,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0	dst=null	perm=null
2013-10-31 16:13:39,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0	dst=null	perm=null
2013-10-31 16:13:40,369 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:13:40,371 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000000_0 is done.
2013-10-31 16:13:40,371 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000000_0  was -1
2013-10-31 16:13:40,371 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:13:40,816 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:13:40,818 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000004_0 is done.
2013-10-31 16:13:40,818 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000004_0  was -1
2013-10-31 16:13:40,818 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:40,843 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:13:40,844 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000002_0 is done.
2013-10-31 16:13:40,844 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000002_0  was -1
2013-10-31 16:13:40,844 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:13:40,848 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:13:40,850 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000003_0 is done.
2013-10-31 16:13:40,850 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000003_0  was -1
2013-10-31 16:13:40,850 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:40,991 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0020_m_000006_0
2013-10-31 16:13:40,991 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0020_m_000006_0
2013-10-31 16:13:40,991 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000006_0 not found in cache
2013-10-31 16:13:41,800 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 16:13:41,804 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 3ms
2013-10-31 16:13:41,999 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000000_0' has completed task_20131031160444934_0020_m_000000 successfully.
2013-10-31 16:13:42,130 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000002_0' has completed task_20131031160444934_0020_m_000002 successfully.
2013-10-31 16:13:42,132 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000003_0' has completed task_20131031160444934_0020_m_000003 successfully.
2013-10-31 16:13:42,134 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000004_0' has completed task_20131031160444934_0020_m_000004 successfully.
2013-10-31 16:13:42,497 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:13:42,501 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:13:42,502 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000001_0 is done.
2013-10-31 16:13:42,502 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000001_0  was -1
2013-10-31 16:13:42,502 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:44,803 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:13:44,811 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:38271, blocks: 62, processing time: 7 msecs
2013-10-31 16:13:44,812 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 62 blocks took 0 msec to generate and 9 msecs for RPC and NN processing
2013-10-31 16:13:45,005 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000001_0' has completed task_20131031160444934_0020_m_000001 successfully.
2013-10-31 16:13:45,009 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0020_m_000005_0' to tip task_20131031160444934_0020_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:45,011 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:13:45,012 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000005_0 which needs 1 slots
2013-10-31 16:13:45,012 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000005_0 which needs 1 slots
2013-10-31 16:13:45,046 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0020/attempt_20131031160444934_0020_m_000005_0. Attempting to reuse: jvm_20131031160444934_0020_m_-1766447982
2013-10-31 16:13:46,024 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_-1766447982 given task: attempt_20131031160444934_0020_m_000005_0
2013-10-31 16:13:46,129 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000005_0 0.0% 
2013-10-31 16:13:46,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary	dst=null	perm=null
2013-10-31 16:13:46,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:46,151 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS from client DFSClient_attempt_20131031160444934_0020_m_000005_0
2013-10-31 16:13:46,151 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0020_m_000005_0
2013-10-31 16:13:46,439 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4227185307943247060 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:46,439 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4227185307943247060 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:46,439 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4227185307943247060 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:46,439 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4227185307943247060 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:46,440 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4109011025327673168 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:46,440 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4109011025327673168 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:46,440 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4109011025327673168 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:46,440 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4109011025327673168 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:46,441 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2391612123643840912 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:46,441 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2391612123643840912 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:46,441 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2391612123643840912 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:46,441 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_218933756069317154 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:46,441 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_218933756069317154 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:46,442 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_218933756069317154 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:46,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020	dst=null	perm=null
2013-10-31 16:13:48,265 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_218933756069317154_1221 blk_2391612123643840912_1220 blk_-4109011025327673168_1219 blk_-4227185307943247060_1218
2013-10-31 16:13:48,265 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_218933756069317154_1221 blk_-4109011025327673168_1219 blk_-4227185307943247060_1218
2013-10-31 16:13:48,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4227185307943247060_1218 file build/test/data/dfs/data/data4/current/blk_-4227185307943247060 for deletion
2013-10-31 16:13:48,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4109011025327673168_1219 file build/test/data/dfs/data/data3/current/blk_-4109011025327673168 for deletion
2013-10-31 16:13:48,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4227185307943247060_1218 at file build/test/data/dfs/data/data4/current/blk_-4227185307943247060
2013-10-31 16:13:48,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4109011025327673168_1219 at file build/test/data/dfs/data/data3/current/blk_-4109011025327673168
2013-10-31 16:13:48,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_218933756069317154_1221 file build/test/data/dfs/data/data4/current/blk_218933756069317154 for deletion
2013-10-31 16:13:48,405 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_218933756069317154_1221 at file build/test/data/dfs/data/data4/current/blk_218933756069317154
2013-10-31 16:13:49,103 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000005_0 0.0% cleanup
2013-10-31 16:13:49,104 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000005_0 is done.
2013-10-31 16:13:49,105 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000005_0  was -1
2013-10-31 16:13:49,105 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:50,805 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4227185307943247060_1218 file build/test/data/dfs/data/data1/current/blk_-4227185307943247060 for deletion
2013-10-31 16:13:50,805 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4109011025327673168_1219 file build/test/data/dfs/data/data1/current/blk_-4109011025327673168 for deletion
2013-10-31 16:13:50,806 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_218933756069317154_1221 file build/test/data/dfs/data/data1/current/blk_218933756069317154 for deletion
2013-10-31 16:13:50,806 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4227185307943247060_1218 at file build/test/data/dfs/data/data1/current/blk_-4227185307943247060
2013-10-31 16:13:50,806 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2391612123643840912_1220 file build/test/data/dfs/data/data2/current/blk_2391612123643840912 for deletion
2013-10-31 16:13:50,806 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4109011025327673168_1219 at file build/test/data/dfs/data/data1/current/blk_-4109011025327673168
2013-10-31 16:13:50,806 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2391612123643840912_1220 at file build/test/data/dfs/data/data2/current/blk_2391612123643840912
2013-10-31 16:13:50,807 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_218933756069317154_1221 at file build/test/data/dfs/data/data1/current/blk_218933756069317154
2013-10-31 16:13:51,020 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000005_0' has completed task_20131031160444934_0020_m_000005 successfully.
2013-10-31 16:13:51,021 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0020 has completed successfully.
2013-10-31 16:13:51,021 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0020,submitTime=1383236007864,launchTime=1383236009486,firstMapTaskLaunchTime=1383236015983,firstJobSetupTaskLaunchTime=1383236009963,firstJobCleanupTaskLaunchTime=1383236025008,finishTime=1383236031021,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[BB76075253814B09B178341B955B63E0/7D1347B078E04565AB065F4EA23AF681] lower*upper1*upper2/(1/1) ...m/joinaroundjoinrightmost
2013-10-31 16:13:51,027 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565. blk_-2034678040060553034_1230
2013-10-31 16:13:51,029 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2034678040060553034_1230 src: /127.0.0.1:48398 dest: /127.0.0.1:47311
2013-10-31 16:13:51,032 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2034678040060553034_1230 src: /127.0.0.1:35366 dest: /127.0.0.1:38271
2013-10-31 16:13:51,033 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2034678040060553034_1230 src: /127.0.0.1:55403 dest: /127.0.0.1:41648
2013-10-31 16:13:51,039 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55403, dest: /127.0.0.1:41648, bytes: 26363, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2034678040060553034_1230, duration: 1518680
2013-10-31 16:13:51,040 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2034678040060553034_1230 terminating
2013-10-31 16:13:51,040 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35366, dest: /127.0.0.1:38271, bytes: 26363, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2034678040060553034_1230, duration: 3981214
2013-10-31 16:13:51,041 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2034678040060553034_1230 terminating
2013-10-31 16:13:51,041 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48398, dest: /127.0.0.1:47311, bytes: 26363, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2034678040060553034_1230, duration: 4938079
2013-10-31 16:13:51,042 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2034678040060553034_1230 terminating
2013-10-31 16:13:51,045 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2034678040060553034_1230 size 26363
2013-10-31 16:13:51,046 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565 from client DFSClient_642840985
2013-10-31 16:13:51,046 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565 is closed by DFSClient_642840985
2013-10-31 16:13:51,047 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2034678040060553034_1230 size 26363
2013-10-31 16:13:51,047 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2034678040060553034_1230 size 26363
2013-10-31 16:13:51,055 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:51,056 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000000_0'
2013-10-31 16:13:51,056 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000001_0'
2013-10-31 16:13:51,056 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000005_0'
2013-10-31 16:13:51,056 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000006_0'
2013-10-31 16:13:51,057 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295404966245382265 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:51,058 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295404966245382265 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:51,058 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295404966245382265 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:51,061 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0020_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:51,064 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary
2013-10-31 16:13:51,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020	dst=null	perm=null
2013-10-31 16:13:51,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2013-10-31 16:13:51,120 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:13:51,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2013-10-31 16:13:51,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2013-10-31 16:13:51,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2013-10-31 16:13:51,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2013-10-31 16:13:51,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2013-10-31 16:13:51,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2013-10-31 16:13:51,131 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35300, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4005825571142535716_1226, duration: 329282
2013-10-31 16:13:51,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2013-10-31 16:13:51,134 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35370, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4251397641509719279_1225, duration: 267103
2013-10-31 16:13:51,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2013-10-31 16:13:51,137 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35302, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3264818105380341287_1229, duration: 271243
2013-10-31 16:13:51,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2013-10-31 16:13:51,140 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55408, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1698530720272675639_1229, duration: 267984
2013-10-31 16:13:51,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2013-10-31 16:13:51,143 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000002_0'
2013-10-31 16:13:51,143 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000003_0'
2013-10-31 16:13:51,147 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48406, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2906097007668293649_1229, duration: 1940252
2013-10-31 16:13:51,148 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000004_0'
2013-10-31 16:13:51,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2013-10-31 16:13:51,165 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:13:51,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2013-10-31 16:13:51,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2013-10-31 16:13:51,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2013-10-31 16:13:51,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2013-10-31 16:13:51,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2013-10-31 16:13:51,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2013-10-31 16:13:51,175 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35374, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4005825571142535716_1226, duration: 273009
2013-10-31 16:13:51,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2013-10-31 16:13:51,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35306, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4251397641509719279_1225, duration: 268143
2013-10-31 16:13:51,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2013-10-31 16:13:51,181 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55412, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3264818105380341287_1229, duration: 269148
2013-10-31 16:13:51,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2013-10-31 16:13:51,184 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35308, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1698530720272675639_1229, duration: 267719
2013-10-31 16:13:51,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2013-10-31 16:13:51,188 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48411, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2906097007668293649_1229, duration: 269556
2013-10-31 16:13:51,188 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost
2013-10-31 16:13:51,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2013-10-31 16:13:51,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2013-10-31 16:13:51,196 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35310, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4005825571142535716_1226, duration: 267063
2013-10-31 16:13:51,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2013-10-31 16:13:51,201 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35380, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4251397641509719279_1225, duration: 290268
2013-10-31 16:13:51,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2013-10-31 16:13:51,205 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35312, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3264818105380341287_1229, duration: 257193
2013-10-31 16:13:51,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2013-10-31 16:13:51,209 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35313, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1698530720272675639_1229, duration: 253326
2013-10-31 16:13:51,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2013-10-31 16:13:51,213 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35383, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2906097007668293649_1229, duration: 254333
2013-10-31 16:13:51,236 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:13:51,236 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:13:51,266 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_295404966245382265_1224 blk_2391612123643840912_1220 blk_-4109011025327673168_1219 blk_-4227185307943247060_1218
2013-10-31 16:13:51,267 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:13:51,267 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_218933756069317154_1221 blk_2391612123643840912_1220 blk_-4109011025327673168_1219 blk_-4227185307943247060_1218
2013-10-31 16:13:51,269 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:13:51,269 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:13:51,270 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone"]
2013-10-31 16:13:51,271 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:13:51,271 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:13:51,271 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:13:51,272 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...dedpipesplatform/joinnone
2013-10-31 16:13:51,277 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:13:51,277 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:13:51,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:51,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:13:51,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,304 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar. blk_-783758398959565497_1231
2013-10-31 16:13:51,306 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-783758398959565497_1231 src: /127.0.0.1:35384 dest: /127.0.0.1:38271
2013-10-31 16:13:51,308 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-783758398959565497_1231 src: /127.0.0.1:35316 dest: /127.0.0.1:50942
2013-10-31 16:13:51,309 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-783758398959565497_1231 src: /127.0.0.1:48419 dest: /127.0.0.1:47311
2013-10-31 16:13:51,320 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48419, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-783758398959565497_1231, duration: 8280493
2013-10-31 16:13:51,320 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-783758398959565497_1231 terminating
2013-10-31 16:13:51,321 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35316, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-783758398959565497_1231, duration: 8125976
2013-10-31 16:13:51,321 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-783758398959565497_1231 terminating
2013-10-31 16:13:51,322 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35384, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-783758398959565497_1231, duration: 9015292
2013-10-31 16:13:51,322 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-783758398959565497_1231 terminating
2013-10-31 16:13:51,324 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-783758398959565497_1231 size 238055
2013-10-31 16:13:51,324 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar from client DFSClient_1457307213
2013-10-31 16:13:51,325 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar is closed by DFSClient_1457307213
2013-10-31 16:13:51,326 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-783758398959565497_1231 size 238055
2013-10-31 16:13:51,326 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-783758398959565497_1231 size 238055
2013-10-31 16:13:51,331 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar. New replication is 10
2013-10-31 16:13:51,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar	dst=null	perm=null
2013-10-31 16:13:51,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,345 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:13:51,350 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:51,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:13:51,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,369 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split. New replication is 10
2013-10-31 16:13:51,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split	dst=null	perm=null
2013-10-31 16:13:51,375 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split. blk_-1167122552337763453_1232
2013-10-31 16:13:51,377 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1167122552337763453_1232 src: /127.0.0.1:35318 dest: /127.0.0.1:50942
2013-10-31 16:13:51,379 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1167122552337763453_1232 src: /127.0.0.1:55424 dest: /127.0.0.1:41648
2013-10-31 16:13:51,380 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1167122552337763453_1232 src: /127.0.0.1:35389 dest: /127.0.0.1:38271
2013-10-31 16:13:51,382 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1167122552337763453_1232 src: /127.0.0.1:48423 dest: /127.0.0.1:47311
2013-10-31 16:13:51,385 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48423, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1167122552337763453_1232, duration: 105811
2013-10-31 16:13:51,386 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1167122552337763453_1232 terminating
2013-10-31 16:13:51,386 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35389, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1167122552337763453_1232, duration: 938909
2013-10-31 16:13:51,387 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1167122552337763453_1232 terminating
2013-10-31 16:13:51,387 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55424, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1167122552337763453_1232, duration: 1944760
2013-10-31 16:13:51,387 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1167122552337763453_1232 terminating
2013-10-31 16:13:51,388 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35318, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1167122552337763453_1232, duration: 2795439
2013-10-31 16:13:51,388 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1167122552337763453_1232 size 1732
2013-10-31 16:13:51,388 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-1167122552337763453_1232 terminating
2013-10-31 16:13:51,390 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1167122552337763453_1232 size 1732
2013-10-31 16:13:51,391 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1167122552337763453_1232 size 1732
2013-10-31 16:13:51,391 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1167122552337763453_1232 size 1732
2013-10-31 16:13:51,392 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split from client DFSClient_1457307213
2013-10-31 16:13:51,392 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split is closed by DFSClient_1457307213
2013-10-31 16:13:51,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,411 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo. blk_-8994134656658539248_1233
2013-10-31 16:13:51,413 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8994134656658539248_1233 src: /127.0.0.1:35322 dest: /127.0.0.1:50942
2013-10-31 16:13:51,414 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8994134656658539248_1233 src: /127.0.0.1:48425 dest: /127.0.0.1:47311
2013-10-31 16:13:51,416 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8994134656658539248_1233 src: /127.0.0.1:35393 dest: /127.0.0.1:38271
2013-10-31 16:13:51,419 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35393, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8994134656658539248_1233, duration: 64038
2013-10-31 16:13:51,419 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8994134656658539248_1233 terminating
2013-10-31 16:13:51,419 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8994134656658539248_1233 size 183
2013-10-31 16:13:51,419 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48425, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8994134656658539248_1233, duration: 882972
2013-10-31 16:13:51,420 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8994134656658539248_1233 terminating
2013-10-31 16:13:51,420 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8994134656658539248_1233 size 183
2013-10-31 16:13:51,420 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35322, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8994134656658539248_1233, duration: 1792590
2013-10-31 16:13:51,421 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8994134656658539248_1233 terminating
2013-10-31 16:13:51,423 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:13:51,423 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:13:51,425 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8994134656658539248_1233 size 183
2013-10-31 16:13:51,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,448 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml. blk_1512274723573382003_1234
2013-10-31 16:13:51,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1512274723573382003_1234 src: /127.0.0.1:48427 dest: /127.0.0.1:47311
2013-10-31 16:13:51,451 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1512274723573382003_1234 src: /127.0.0.1:35395 dest: /127.0.0.1:38271
2013-10-31 16:13:51,452 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1512274723573382003_1234 src: /127.0.0.1:35327 dest: /127.0.0.1:50942
2013-10-31 16:13:51,455 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35327, dest: /127.0.0.1:50942, bytes: 28297, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1512274723573382003_1234, duration: 504003
2013-10-31 16:13:51,456 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1512274723573382003_1234 terminating
2013-10-31 16:13:51,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35395, dest: /127.0.0.1:38271, bytes: 28297, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1512274723573382003_1234, duration: 938601
2013-10-31 16:13:51,457 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1512274723573382003_1234 terminating
2013-10-31 16:13:51,457 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1512274723573382003_1234 size 28297
2013-10-31 16:13:51,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48427, dest: /127.0.0.1:47311, bytes: 28297, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1512274723573382003_1234, duration: 1796713
2013-10-31 16:13:51,457 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1512274723573382003_1234 size 28297
2013-10-31 16:13:51,458 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1512274723573382003_1234 terminating
2013-10-31 16:13:51,459 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml from client DFSClient_1457307213
2013-10-31 16:13:51,460 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml is closed by DFSClient_1457307213
2013-10-31 16:13:51,461 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1512274723573382003_1234 size 28297
2013-10-31 16:13:52,018 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4227185307943247060_1218 file build/test/data/dfs/data/data6/current/blk_-4227185307943247060 for deletion
2013-10-31 16:13:52,018 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4109011025327673168_1219 file build/test/data/dfs/data/data5/current/blk_-4109011025327673168 for deletion
2013-10-31 16:13:52,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4227185307943247060_1218 at file build/test/data/dfs/data/data6/current/blk_-4227185307943247060
2013-10-31 16:13:52,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4109011025327673168_1219 at file build/test/data/dfs/data/data5/current/blk_-4109011025327673168
2013-10-31 16:13:52,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295404966245382265_1224 file build/test/data/dfs/data/data6/current/blk_295404966245382265 for deletion
2013-10-31 16:13:52,020 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2391612123643840912_1220 file build/test/data/dfs/data/data6/current/blk_2391612123643840912 for deletion
2013-10-31 16:13:52,020 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295404966245382265_1224 at file build/test/data/dfs/data/data6/current/blk_295404966245382265
2013-10-31 16:13:52,020 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2391612123643840912_1220 at file build/test/data/dfs/data/data6/current/blk_2391612123643840912
2013-10-31 16:13:53,367 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0020
2013-10-31 16:13:53,368 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0020 being deleted.
2013-10-31 16:13:53,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml	dst=null	perm=null
2013-10-31 16:13:53,402 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35398, bytes: 28521, op: HDFS_READ, cliID: DFSClient_1797627655, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1512274723573382003_1234, duration: 414421
2013-10-31 16:13:53,419 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0021: nMaps=5 nReduces=0 max=-1
2013-10-31 16:13:53,420 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0021 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:13:53,420 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0021	RESULT=SUCCESS
2013-10-31 16:13:53,420 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0021
2013-10-31 16:13:53,420 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0021
2013-10-31 16:13:53,421 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0021
2013-10-31 16:13:53,610 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1252 Total time for transactions(ms): 26Number of transactions batched in Syncs: 128 Number of syncs: 892 SyncTimes(ms): 38844 6451 
2013-10-31 16:13:53,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:54,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:54,009 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4227185307943247060_1218 file build/test/data/dfs/data/data7/current/blk_-4227185307943247060 for deletion
2013-10-31 16:13:54,009 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4109011025327673168_1219 file build/test/data/dfs/data/data8/current/blk_-4109011025327673168 for deletion
2013-10-31 16:13:54,010 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4227185307943247060_1218 at file build/test/data/dfs/data/data7/current/blk_-4227185307943247060
2013-10-31 16:13:54,010 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4109011025327673168_1219 at file build/test/data/dfs/data/data8/current/blk_-4109011025327673168
2013-10-31 16:13:54,010 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_conf.xml. blk_-3040086649751188610_1236
2013-10-31 16:13:54,010 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_218933756069317154_1221 file build/test/data/dfs/data/data8/current/blk_218933756069317154 for deletion
2013-10-31 16:13:54,011 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2391612123643840912_1220 file build/test/data/dfs/data/data7/current/blk_2391612123643840912 for deletion
2013-10-31 16:13:54,011 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_218933756069317154_1221 at file build/test/data/dfs/data/data8/current/blk_218933756069317154
2013-10-31 16:13:54,011 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2391612123643840912_1220 at file build/test/data/dfs/data/data7/current/blk_2391612123643840912
2013-10-31 16:13:54,012 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3040086649751188610_1236 src: /127.0.0.1:35399 dest: /127.0.0.1:38271
2013-10-31 16:13:54,014 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3040086649751188610_1236 src: /127.0.0.1:35331 dest: /127.0.0.1:50942
2013-10-31 16:13:54,016 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3040086649751188610_1236 src: /127.0.0.1:48434 dest: /127.0.0.1:47311
2013-10-31 16:13:54,020 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48434, dest: /127.0.0.1:47311, bytes: 28362, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3040086649751188610_1236, duration: 979359
2013-10-31 16:13:54,020 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3040086649751188610_1236 terminating
2013-10-31 16:13:54,021 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35331, dest: /127.0.0.1:50942, bytes: 28362, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3040086649751188610_1236, duration: 1813100
2013-10-31 16:13:54,021 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3040086649751188610_1236 terminating
2013-10-31 16:13:54,021 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3040086649751188610_1236 size 28362
2013-10-31 16:13:54,022 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35399, dest: /127.0.0.1:38271, bytes: 28362, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3040086649751188610_1236, duration: 2935291
2013-10-31 16:13:54,022 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3040086649751188610_1236 terminating
2013-10-31 16:13:54,024 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_conf.xml from client DFSClient_1797627655
2013-10-31 16:13:54,025 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_conf.xml is closed by DFSClient_1797627655
2013-10-31 16:13:54,025 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3040086649751188610_1236 size 28362
2013-10-31 16:13:54,026 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3040086649751188610_1236 size 28362
2013-10-31 16:13:54,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:54,037 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken. blk_6670313106925088236_1237
2013-10-31 16:13:54,039 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6670313106925088236_1237 src: /127.0.0.1:55438 dest: /127.0.0.1:41648
2013-10-31 16:13:54,040 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6670313106925088236_1237 src: /127.0.0.1:48436 dest: /127.0.0.1:47311
2013-10-31 16:13:54,042 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6670313106925088236_1237 src: /127.0.0.1:35404 dest: /127.0.0.1:38271
2013-10-31 16:13:54,044 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35404, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6670313106925088236_1237, duration: 63997
2013-10-31 16:13:54,045 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6670313106925088236_1237 terminating
2013-10-31 16:13:54,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48436, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6670313106925088236_1237, duration: 854947
2013-10-31 16:13:54,046 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6670313106925088236_1237 terminating
2013-10-31 16:13:54,046 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6670313106925088236_1237 size 116
2013-10-31 16:13:54,046 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55438, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6670313106925088236_1237, duration: 1775883
2013-10-31 16:13:54,047 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6670313106925088236_1237 terminating
2013-10-31 16:13:54,049 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6670313106925088236_1237 size 116
2013-10-31 16:13:54,049 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken from client DFSClient_1457307213
2013-10-31 16:13:54,049 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken is closed by DFSClient_1457307213
2013-10-31 16:13:54,050 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6670313106925088236_1237 size 116
2013-10-31 16:13:54,055 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken
2013-10-31 16:13:54,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:13:54,059 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35405, bytes: 187, op: HDFS_READ, cliID: DFSClient_1797627655, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8994134656658539248_1233, duration: 270166
2013-10-31 16:13:54,061 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0021 = 19. Number of splits = 5
2013-10-31 16:13:54,061 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,061 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,062 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,062 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,062 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,062 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,063 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,063 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,063 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,063 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,065 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0021 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:13:54,065 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0021 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:13:54,151 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0021_m_000006_0' to tip task_20131031160444934_0021_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:13:54,159 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:13:54,159 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000006_0 which needs 1 slots
2013-10-31 16:13:54,159 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000006_0 which needs 1 slots
2013-10-31 16:13:54,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken	dst=null	perm=null
2013-10-31 16:13:54,167 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48439, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6670313106925088236_1237, duration: 287562
2013-10-31 16:13:54,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml	dst=null	perm=null
2013-10-31 16:13:54,177 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35339, bytes: 28521, op: HDFS_READ, cliID: DFSClient_694759781, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1512274723573382003_1234, duration: 378560
2013-10-31 16:13:54,207 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:54,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar	dst=null	perm=null
2013-10-31 16:13:54,232 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35409, bytes: 239915, op: HDFS_READ, cliID: DFSClient_694759781, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-783758398959565497_1231, duration: 1313300
2013-10-31 16:13:54,269 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-783758398959565497_1231 to datanode(s) 127.0.0.1:41648
2013-10-31 16:13:54,269 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_295404966245382265_1224
2013-10-31 16:13:54,270 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_295404966245382265_1224
2013-10-31 16:13:54,342 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0020_m_2133656262
2013-10-31 16:13:54,349 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21901 with signal TERM. Exit code 0
2013-10-31 16:13:54,349 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_1540783417
2013-10-31 16:13:54,350 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_1540783417 spawned.
2013-10-31 16:13:54,356 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000006_0/taskjvm.sh
2013-10-31 16:13:54,405 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-783758398959565497_1231 to 127.0.0.1:41648 
2013-10-31 16:13:54,406 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295404966245382265_1224 file build/test/data/dfs/data/data4/current/blk_295404966245382265 for deletion
2013-10-31 16:13:54,406 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295404966245382265_1224 at file build/test/data/dfs/data/data4/current/blk_295404966245382265
2013-10-31 16:13:54,407 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-783758398959565497_1231 src: /127.0.0.1:55446 dest: /127.0.0.1:41648
2013-10-31 16:13:54,408 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-783758398959565497_1231 to /127.0.0.1:41648
2013-10-31 16:13:54,409 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-783758398959565497_1231 src: /127.0.0.1:55446 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:13:54,410 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-783758398959565497_1231 size 238055
2013-10-31 16:13:54,413 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:54,413 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:54,413 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:54,413 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_2133656262 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:55,706 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_1540783417 given task: attempt_20131031160444934_0021_m_000006_0
2013-10-31 16:13:56,058 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0020
2013-10-31 16:13:56,058 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000000_0 not found in cache
2013-10-31 16:13:56,058 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000001_0 not found in cache
2013-10-31 16:13:56,058 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000005_0 not found in cache
2013-10-31 16:13:56,059 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0020 for user-log deletion with retainTimeStamp:1383322436059
2013-10-31 16:13:56,147 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0020
2013-10-31 16:13:56,147 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000003_0 not found in cache
2013-10-31 16:13:56,147 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000002_0 not found in cache
2013-10-31 16:13:56,148 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0020 for user-log deletion with retainTimeStamp:1383322436148
2013-10-31 16:13:56,149 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0020
2013-10-31 16:13:56,149 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000004_0 not found in cache
2013-10-31 16:13:56,150 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0020 for user-log deletion with retainTimeStamp:1383322436150
2013-10-31 16:13:56,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:56,387 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0020_m_-114402403 since job job_20131031160444934_0020 is dead
2013-10-31 16:13:56,397 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21868 with signal TERM. Exit code 0
2013-10-31 16:13:56,407 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0020_m_1147863550 since job job_20131031160444934_0020 is dead
2013-10-31 16:13:56,419 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21900 with signal TERM. Exit code 0
2013-10-31 16:13:56,591 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:56,591 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:56,592 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:56,592 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_-114402403 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:56,596 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:56,596 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:56,596 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:56,596 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_1147863550 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:56,807 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295404966245382265_1224 file build/test/data/dfs/data/data2/current/blk_295404966245382265 for deletion
2013-10-31 16:13:56,807 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295404966245382265_1224 at file build/test/data/dfs/data/data2/current/blk_295404966245382265
2013-10-31 16:13:57,142 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0020_m_-1766447982 since job job_20131031160444934_0020 is dead
2013-10-31 16:13:57,152 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21653 with signal TERM. Exit code 0
2013-10-31 16:13:57,319 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:57,319 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:57,320 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:57,320 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_-1766447982 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:13:57,446 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0020_m_1620994915 since job job_20131031160444934_0020 is dead
2013-10-31 16:13:57,455 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21785 with signal TERM. Exit code 0
2013-10-31 16:13:57,640 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:57,641 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:57,641 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:13:57,641 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_1620994915 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:59,123 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000006_0 0.0% setup
2013-10-31 16:13:59,126 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000006_0 is done.
2013-10-31 16:13:59,126 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000006_0  was -1
2013-10-31 16:13:59,126 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:00,165 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000006_0' has completed task_20131031160444934_0021_m_000006 successfully.
2013-10-31 16:14:00,168 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000000_0' to tip task_20131031160444934_0021_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:00,169 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000000
2013-10-31 16:14:00,170 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000001_0' to tip task_20131031160444934_0021_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:00,170 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000001
2013-10-31 16:14:00,172 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000002_0' to tip task_20131031160444934_0021_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:14:00,173 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:14:00,174 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000002
2013-10-31 16:14:00,174 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:14:00,175 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000003_0' to tip task_20131031160444934_0021_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:14:00,175 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000000_0 which needs 1 slots
2013-10-31 16:14:00,175 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000000_0 which needs 1 slots
2013-10-31 16:14:00,175 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000003
2013-10-31 16:14:00,176 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000001_0 which needs 1 slots
2013-10-31 16:14:00,176 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0021_m_000001_0 which needs 1 slots
2013-10-31 16:14:00,181 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:14:00,186 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:14:00,187 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000002_0 which needs 1 slots
2013-10-31 16:14:00,188 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000002_0 which needs 1 slots
2013-10-31 16:14:00,188 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000003_0 which needs 1 slots
2013-10-31 16:14:00,189 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0021_m_000003_0 which needs 1 slots
2013-10-31 16:14:00,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken	dst=null	perm=null
2013-10-31 16:14:00,197 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35414, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6670313106925088236_1237, duration: 290545
2013-10-31 16:14:00,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml	dst=null	perm=null
2013-10-31 16:14:00,208 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48449, bytes: 28521, op: HDFS_READ, cliID: DFSClient_1593933664, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1512274723573382003_1234, duration: 380739
2013-10-31 16:14:00,230 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_1814097211
2013-10-31 16:14:00,231 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_1814097211 spawned.
2013-10-31 16:14:00,233 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0021/attempt_20131031160444934_0021_m_000000_0. Attempting to reuse: jvm_20131031160444934_0021_m_1540783417
2013-10-31 16:14:00,234 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000001_0/taskjvm.sh
2013-10-31 16:14:00,336 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:00,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar	dst=null	perm=null
2013-10-31 16:14:00,358 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55453, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1593933664, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-783758398959565497_1231, duration: 701158
2013-10-31 16:14:00,412 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_-1019684994
2013-10-31 16:14:00,413 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_-1019684994 spawned.
2013-10-31 16:14:00,413 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_-1214335477
2013-10-31 16:14:00,414 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_-1214335477 spawned.
2013-10-31 16:14:00,414 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000002_0/taskjvm.sh
2013-10-31 16:14:00,415 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000003_0/taskjvm.sh
2013-10-31 16:14:00,691 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_1540783417 given task: attempt_20131031160444934_0021_m_000000_0
2013-10-31 16:14:00,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split	dst=null	perm=null
2013-10-31 16:14:00,877 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35420, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1167122552337763453_1232, duration: 196511
2013-10-31 16:14:00,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:00,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:00,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:01,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:01,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:01,173 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48454, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 130330
2013-10-31 16:14:01,176 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35422, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 142616
2013-10-31 16:14:01,183 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000. blk_-8929482607814041237_1238
2013-10-31 16:14:01,199 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8929482607814041237_1238 src: /127.0.0.1:35423 dest: /127.0.0.1:38271
2013-10-31 16:14:01,200 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8929482607814041237_1238 src: /127.0.0.1:48457 dest: /127.0.0.1:47311
2013-10-31 16:14:01,200 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8929482607814041237_1238 src: /127.0.0.1:35356 dest: /127.0.0.1:50942
2013-10-31 16:14:01,203 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35356, dest: /127.0.0.1:50942, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8929482607814041237_1238, duration: 1310205
2013-10-31 16:14:01,203 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8929482607814041237_1238 terminating
2013-10-31 16:14:01,203 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8929482607814041237_1238 size 40
2013-10-31 16:14:01,203 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48457, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8929482607814041237_1238, duration: 1660806
2013-10-31 16:14:01,203 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8929482607814041237_1238 terminating
2013-10-31 16:14:01,204 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35423, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8929482607814041237_1238, duration: 2200956
2013-10-31 16:14:01,204 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8929482607814041237_1238 terminating
2013-10-31 16:14:01,204 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8929482607814041237_1238 size 40
2013-10-31 16:14:01,206 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0021_m_000000_0
2013-10-31 16:14:01,206 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0021_m_000000_0
2013-10-31 16:14:01,208 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8929482607814041237_1238 size 40
2013-10-31 16:14:01,244 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:01,244 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000000_0 0.0% 
2013-10-31 16:14:01,380 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_1814097211 given task: attempt_20131031160444934_0021_m_000001_0
2013-10-31 16:14:01,591 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_-1019684994 given task: attempt_20131031160444934_0021_m_000002_0
2013-10-31 16:14:01,615 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_-1214335477 given task: attempt_20131031160444934_0021_m_000003_0
2013-10-31 16:14:01,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split	dst=null	perm=null
2013-10-31 16:14:01,895 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48463, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1167122552337763453_1232, duration: 169549
2013-10-31 16:14:01,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:01,934 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48464, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 124988
2013-10-31 16:14:01,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:01,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:02,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split	dst=null	perm=null
2013-10-31 16:14:02,107 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35434, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1167122552337763453_1232, duration: 164836
2013-10-31 16:14:02,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split	dst=null	perm=null
2013-10-31 16:14:02,119 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55471, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1167122552337763453_1232, duration: 156535
2013-10-31 16:14:02,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:02,147 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35367, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 141841
2013-10-31 16:14:02,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:02,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:02,160 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35368, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 128429
2013-10-31 16:14:02,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:02,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:02,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:02,166 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55474, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 111462
2013-10-31 16:14:02,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:02,176 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001. blk_1176319995048386474_1241
2013-10-31 16:14:02,199 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1176319995048386474_1241 src: /127.0.0.1:35370 dest: /127.0.0.1:50942
2013-10-31 16:14:02,200 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1176319995048386474_1241 src: /127.0.0.1:35440 dest: /127.0.0.1:38271
2013-10-31 16:14:02,201 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1176319995048386474_1241 src: /127.0.0.1:48474 dest: /127.0.0.1:47311
2013-10-31 16:14:02,205 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48474, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1176319995048386474_1241, duration: 910475
2013-10-31 16:14:02,205 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1176319995048386474_1241 terminating
2013-10-31 16:14:02,205 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35440, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1176319995048386474_1241, duration: 1676758
2013-10-31 16:14:02,206 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1176319995048386474_1241 terminating
2013-10-31 16:14:02,206 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1176319995048386474_1241 size 40
2013-10-31 16:14:02,207 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35370, dest: /127.0.0.1:50942, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1176319995048386474_1241, duration: 2596684
2013-10-31 16:14:02,207 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1176319995048386474_1241 size 40
2013-10-31 16:14:02,207 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1176319995048386474_1241 terminating
2013-10-31 16:14:02,209 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1176319995048386474_1241 size 40
2013-10-31 16:14:02,209 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0021_m_000001_0
2013-10-31 16:14:02,210 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0021_m_000001_0
2013-10-31 16:14:02,376 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000004_0' to tip task_20131031160444934_0021_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:02,377 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000004
2013-10-31 16:14:02,380 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:14:02,381 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000004_0 which needs 1 slots
2013-10-31 16:14:02,381 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000004_0 which needs 1 slots
2013-10-31 16:14:02,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken	dst=null	perm=null
2013-10-31 16:14:02,393 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55478, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6670313106925088236_1237, duration: 290893
2013-10-31 16:14:02,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml	dst=null	perm=null
2013-10-31 16:14:02,402 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35444, bytes: 28521, op: HDFS_READ, cliID: DFSClient_2146416705, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1512274723573382003_1234, duration: 156530
2013-10-31 16:14:02,425 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:02,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar	dst=null	perm=null
2013-10-31 16:14:02,440 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35376, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2146416705, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-783758398959565497_1231, duration: 1009015
2013-10-31 16:14:02,528 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_-170222416
2013-10-31 16:14:02,530 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_-170222416 spawned.
2013-10-31 16:14:02,532 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000004_0/taskjvm.sh
2013-10-31 16:14:03,177 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000000_0
2013-10-31 16:14:05,175 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0021_m_000006_0
2013-10-31 16:14:05,175 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0021_m_000006_0
2013-10-31 16:14:05,176 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000006_0 not found in cache
2013-10-31 16:14:05,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0	dst=null	perm=null
2013-10-31 16:14:05,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:05,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:05,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:05,949 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55482, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 131664
2013-10-31 16:14:05,958 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002. blk_936374191023625769_1241
2013-10-31 16:14:05,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:05,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:05,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0	dst=null	perm=null
2013-10-31 16:14:05,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_936374191023625769_1241 src: /127.0.0.1:48480 dest: /127.0.0.1:47311
2013-10-31 16:14:05,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_936374191023625769_1241 src: /127.0.0.1:55484 dest: /127.0.0.1:41648
2013-10-31 16:14:05,995 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_936374191023625769_1241 src: /127.0.0.1:35380 dest: /127.0.0.1:50942
2013-10-31 16:14:05,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35380, dest: /127.0.0.1:50942, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_936374191023625769_1241, duration: 1344195
2013-10-31 16:14:05,997 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_936374191023625769_1241 terminating
2013-10-31 16:14:05,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55484, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_936374191023625769_1241, duration: 1447378
2013-10-31 16:14:05,998 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_936374191023625769_1241 terminating
2013-10-31 16:14:05,998 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48480, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_936374191023625769_1241, duration: 1865727
2013-10-31 16:14:05,998 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_936374191023625769_1241 terminating
2013-10-31 16:14:05,999 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_936374191023625769_1241 size 40
2013-10-31 16:14:06,000 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0021_m_000002_0
2013-10-31 16:14:06,000 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0021_m_000002_0
2013-10-31 16:14:06,000 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_936374191023625769_1241 size 40
2013-10-31 16:14:06,001 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_936374191023625769_1241 size 40
2013-10-31 16:14:06,013 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:06,014 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000001_0 0.0% 
2013-10-31 16:14:06,046 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:06,046 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000002_0 0.0% 
2013-10-31 16:14:06,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:06,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:06,177 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55486, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 141756
2013-10-31 16:14:06,179 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000001_0
2013-10-31 16:14:06,185 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000002_0
2013-10-31 16:14:06,187 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003. blk_3252984414706521299_1241
2013-10-31 16:14:06,213 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3252984414706521299_1241 src: /127.0.0.1:35451 dest: /127.0.0.1:38271
2013-10-31 16:14:06,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3252984414706521299_1241 src: /127.0.0.1:48485 dest: /127.0.0.1:47311
2013-10-31 16:14:06,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3252984414706521299_1241 src: /127.0.0.1:55489 dest: /127.0.0.1:41648
2013-10-31 16:14:06,217 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55489, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3252984414706521299_1241, duration: 949388
2013-10-31 16:14:06,217 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3252984414706521299_1241 terminating
2013-10-31 16:14:06,217 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48485, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3252984414706521299_1241, duration: 1290711
2013-10-31 16:14:06,217 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3252984414706521299_1241 terminating
2013-10-31 16:14:06,217 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35451, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3252984414706521299_1241, duration: 1712448
2013-10-31 16:14:06,218 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3252984414706521299_1241 terminating
2013-10-31 16:14:06,218 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3252984414706521299_1241 size 40
2013-10-31 16:14:06,219 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3252984414706521299_1241 size 40
2013-10-31 16:14:06,219 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0021_m_000003_0
2013-10-31 16:14:06,219 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0021_m_000003_0
2013-10-31 16:14:06,220 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3252984414706521299_1241 size 40
2013-10-31 16:14:06,269 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:06,269 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000003_0 0.0% 
2013-10-31 16:14:06,723 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_-170222416 given task: attempt_20131031160444934_0021_m_000004_0
2013-10-31 16:14:06,871 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:14:06,873 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:14:06,874 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000000_0 is done.
2013-10-31 16:14:06,874 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000000_0  was -1
2013-10-31 16:14:06,874 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:07,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0	dst=null	perm=null
2013-10-31 16:14:07,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:07,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:07,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0	dst=null	perm=null
2013-10-31 16:14:07,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0	dst=null	perm=null
2013-10-31 16:14:07,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:07,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:07,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0	dst=null	perm=null
2013-10-31 16:14:07,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split	dst=null	perm=null
2013-10-31 16:14:07,228 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35387, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1167122552337763453_1232, duration: 369914
2013-10-31 16:14:07,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:07,268 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35457, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 260861
2013-10-31 16:14:07,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:07,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:07,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:07,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:14:07,508 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55494, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 140633
2013-10-31 16:14:07,517 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004. blk_-8273281274980003916_1242
2013-10-31 16:14:07,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8273281274980003916_1242 src: /127.0.0.1:48492 dest: /127.0.0.1:47311
2013-10-31 16:14:07,541 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8273281274980003916_1242 src: /127.0.0.1:55496 dest: /127.0.0.1:41648
2013-10-31 16:14:07,542 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8273281274980003916_1242 src: /127.0.0.1:35461 dest: /127.0.0.1:38271
2013-10-31 16:14:07,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35461, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8273281274980003916_1242, duration: 1443188
2013-10-31 16:14:07,544 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8273281274980003916_1242 terminating
2013-10-31 16:14:07,545 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55496, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8273281274980003916_1242, duration: 1619111
2013-10-31 16:14:07,545 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8273281274980003916_1242 terminating
2013-10-31 16:14:07,545 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48492, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8273281274980003916_1242, duration: 2496030
2013-10-31 16:14:07,545 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8273281274980003916_1242 size 40
2013-10-31 16:14:07,546 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8273281274980003916_1242 terminating
2013-10-31 16:14:07,546 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8273281274980003916_1242 size 40
2013-10-31 16:14:07,547 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8273281274980003916_1242 size 40
2013-10-31 16:14:07,547 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0021_m_000004_0
2013-10-31 16:14:07,548 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0021_m_000004_0
2013-10-31 16:14:07,613 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:07,613 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000004_0 0.0% 
2013-10-31 16:14:07,864 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:07,867 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:07,868 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000001_0 is done.
2013-10-31 16:14:07,869 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000001_0  was -1
2013-10-31 16:14:07,869 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:08,064 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:14:08,068 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:14:08,069 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000002_0 is done.
2013-10-31 16:14:08,069 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000002_0  was -1
2013-10-31 16:14:08,069 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:08,075 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:08,389 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000004_0
2013-10-31 16:14:08,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0	dst=null	perm=null
2013-10-31 16:14:08,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:08,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:08,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0	dst=null	perm=null
2013-10-31 16:14:09,183 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000000_0' has completed task_20131031160444934_0021_m_000000 successfully.
2013-10-31 16:14:09,185 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000001_0' has completed task_20131031160444934_0021_m_000001 successfully.
2013-10-31 16:14:09,189 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000002_0' has completed task_20131031160444934_0021_m_000002 successfully.
2013-10-31 16:14:09,190 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000003_0
2013-10-31 16:14:09,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0	dst=null	perm=null
2013-10-31 16:14:09,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:10,143 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:14:10,144 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000004_0 is done.
2013-10-31 16:14:10,144 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000004_0  was -1
2013-10-31 16:14:10,145 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:10,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:10,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0	dst=null	perm=null
2013-10-31 16:14:11,142 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:11,146 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:11,147 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000003_0 is done.
2013-10-31 16:14:11,147 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000003_0  was -1
2013-10-31 16:14:11,148 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:11,393 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000004_0' has completed task_20131031160444934_0021_m_000004 successfully.
2013-10-31 16:14:12,193 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000003_0' has completed task_20131031160444934_0021_m_000003 successfully.
2013-10-31 16:14:12,197 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0021_m_000005_0' to tip task_20131031160444934_0021_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:14:12,199 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:14:12,200 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000005_0 which needs 1 slots
2013-10-31 16:14:12,200 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000005_0 which needs 1 slots
2013-10-31 16:14:12,229 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0021/attempt_20131031160444934_0021_m_000005_0. Attempting to reuse: jvm_20131031160444934_0021_m_-1214335477
2013-10-31 16:14:12,685 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_-1214335477 given task: attempt_20131031160444934_0021_m_000005_0
2013-10-31 16:14:12,782 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000005_0 0.0% 
2013-10-31 16:14:12,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary	dst=null	perm=null
2013-10-31 16:14:12,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:12,804 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_SUCCESS from client DFSClient_attempt_20131031160444934_0021_m_000005_0
2013-10-31 16:14:12,804 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0021_m_000005_0
2013-10-31 16:14:12,813 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-783758398959565497 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:12,813 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-783758398959565497 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:12,813 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-783758398959565497 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:12,813 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-783758398959565497 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:12,814 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1167122552337763453 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:12,814 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1167122552337763453 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:12,814 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1167122552337763453 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:12,814 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1167122552337763453 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:12,814 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8994134656658539248 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:12,815 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8994134656658539248 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:12,815 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8994134656658539248 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:12,815 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1512274723573382003 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:12,815 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1512274723573382003 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:12,816 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1512274723573382003 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:12,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021	dst=null	perm=null
2013-10-31 16:14:15,273 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-783758398959565497_1231 blk_-1167122552337763453_1232
2013-10-31 16:14:15,273 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_1512274723573382003_1234 blk_-783758398959565497_1231 blk_-1167122552337763453_1232 blk_-8994134656658539248_1233
2013-10-31 16:14:15,756 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000005_0 0.0% cleanup
2013-10-31 16:14:15,758 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000005_0 is done.
2013-10-31 16:14:15,758 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000005_0  was -1
2013-10-31 16:14:15,758 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:16,026 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1167122552337763453_1232 file build/test/data/dfs/data/data6/current/blk_-1167122552337763453 for deletion
2013-10-31 16:14:16,026 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-783758398959565497_1231 file build/test/data/dfs/data/data6/current/blk_-783758398959565497 for deletion
2013-10-31 16:14:16,037 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1167122552337763453_1232 at file build/test/data/dfs/data/data6/current/blk_-1167122552337763453
2013-10-31 16:14:16,037 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-783758398959565497_1231 at file build/test/data/dfs/data/data6/current/blk_-783758398959565497
2013-10-31 16:14:18,018 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8994134656658539248_1233 file build/test/data/dfs/data/data7/current/blk_-8994134656658539248 for deletion
2013-10-31 16:14:18,018 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1167122552337763453_1232 file build/test/data/dfs/data/data8/current/blk_-1167122552337763453 for deletion
2013-10-31 16:14:18,018 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8994134656658539248_1233 at file build/test/data/dfs/data/data7/current/blk_-8994134656658539248
2013-10-31 16:14:18,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1167122552337763453_1232 at file build/test/data/dfs/data/data8/current/blk_-1167122552337763453
2013-10-31 16:14:18,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-783758398959565497_1231 file build/test/data/dfs/data/data7/current/blk_-783758398959565497 for deletion
2013-10-31 16:14:18,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1512274723573382003_1234 file build/test/data/dfs/data/data8/current/blk_1512274723573382003 for deletion
2013-10-31 16:14:18,020 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-783758398959565497_1231 at file build/test/data/dfs/data/data7/current/blk_-783758398959565497
2013-10-31 16:14:18,020 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1512274723573382003_1234 at file build/test/data/dfs/data/data8/current/blk_1512274723573382003
2013-10-31 16:14:18,206 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000005_0' has completed task_20131031160444934_0021_m_000005 successfully.
2013-10-31 16:14:18,207 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0021 has completed successfully.
2013-10-31 16:14:18,207 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0021,submitTime=1383236033391,launchTime=1383236034065,firstMapTaskLaunchTime=1383236040168,firstJobSetupTaskLaunchTime=1383236034151,firstJobCleanupTaskLaunchTime=1383236052197,finishTime=1383236058207,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=48,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[40059A3D98A44FF1ACD4467F4697661C/5993B28B7E41438FB05DA3B1E4AF04BD] lower*upper/(1/1) ...dedpipesplatform/joinnone
2013-10-31 16:14:18,216 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F. blk_-5995995560352840120_1243
2013-10-31 16:14:18,218 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5995995560352840120_1243 src: /127.0.0.1:55500 dest: /127.0.0.1:41648
2013-10-31 16:14:18,220 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5995995560352840120_1243 src: /127.0.0.1:35396 dest: /127.0.0.1:50942
2013-10-31 16:14:18,222 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5995995560352840120_1243 src: /127.0.0.1:35466 dest: /127.0.0.1:38271
2013-10-31 16:14:18,230 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35466, dest: /127.0.0.1:38271, bytes: 26371, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5995995560352840120_1243, duration: 3695606
2013-10-31 16:14:18,231 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5995995560352840120_1243 terminating
2013-10-31 16:14:18,231 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35396, dest: /127.0.0.1:50942, bytes: 26371, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5995995560352840120_1243, duration: 3904422
2013-10-31 16:14:18,232 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5995995560352840120_1243 terminating
2013-10-31 16:14:18,236 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55500, dest: /127.0.0.1:41648, bytes: 26371, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5995995560352840120_1243, duration: 5345670
2013-10-31 16:14:18,236 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5995995560352840120_1243 size 26371
2013-10-31 16:14:18,236 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5995995560352840120_1243 terminating
2013-10-31 16:14:18,241 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5995995560352840120_1243 size 26371
2013-10-31 16:14:18,241 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F from client DFSClient_1797627655
2013-10-31 16:14:18,242 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F is closed by DFSClient_1797627655
2013-10-31 16:14:18,242 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5995995560352840120_1243 size 26371
2013-10-31 16:14:18,248 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:14:18,248 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000002_0'
2013-10-31 16:14:18,249 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000003_0'
2013-10-31 16:14:18,249 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000005_0'
2013-10-31 16:14:18,250 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6670313106925088236 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:18,251 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6670313106925088236 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:18,251 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6670313106925088236 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:18,254 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0021_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:14:18,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021	dst=null	perm=null
2013-10-31 16:14:18,258 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary
2013-10-31 16:14:18,274 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_6670313106925088236_1237 blk_1512274723573382003_1234 blk_-783758398959565497_1231 blk_-1167122552337763453_1232 blk_-8994134656658539248_1233
2013-10-31 16:14:18,274 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_6670313106925088236_1237 blk_1512274723573382003_1234 blk_-783758398959565497_1231 blk_-1167122552337763453_1232 blk_-8994134656658539248_1233
2013-10-31 16:14:18,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2013-10-31 16:14:18,279 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:14:18,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2013-10-31 16:14:18,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2013-10-31 16:14:18,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2013-10-31 16:14:18,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2013-10-31 16:14:18,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2013-10-31 16:14:18,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2013-10-31 16:14:18,287 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35399, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8929482607814041237_1238, duration: 350209
2013-10-31 16:14:18,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2013-10-31 16:14:18,289 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35469, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1176319995048386474_1241, duration: 273759
2013-10-31 16:14:18,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2013-10-31 16:14:18,291 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48503, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_936374191023625769_1241, duration: 145630
2013-10-31 16:14:18,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2013-10-31 16:14:18,293 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35471, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3252984414706521299_1241, duration: 276262
2013-10-31 16:14:18,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2013-10-31 16:14:18,296 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48505, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8273281274980003916_1242, duration: 277305
2013-10-31 16:14:18,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2013-10-31 16:14:18,304 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:14:18,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2013-10-31 16:14:18,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2013-10-31 16:14:18,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2013-10-31 16:14:18,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2013-10-31 16:14:18,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2013-10-31 16:14:18,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2013-10-31 16:14:18,311 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35404, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8929482607814041237_1238, duration: 273368
2013-10-31 16:14:18,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2013-10-31 16:14:18,314 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35474, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1176319995048386474_1241, duration: 271841
2013-10-31 16:14:18,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2013-10-31 16:14:18,316 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48508, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_936374191023625769_1241, duration: 275468
2013-10-31 16:14:18,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2013-10-31 16:14:18,318 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35476, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3252984414706521299_1241, duration: 269672
2013-10-31 16:14:18,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2013-10-31 16:14:18,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55513, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8273281274980003916_1242, duration: 265689
2013-10-31 16:14:18,321 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinnone
2013-10-31 16:14:18,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2013-10-31 16:14:18,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2013-10-31 16:14:18,327 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35409, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8929482607814041237_1238, duration: 264778
2013-10-31 16:14:18,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2013-10-31 16:14:18,330 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35479, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1176319995048386474_1241, duration: 263501
2013-10-31 16:14:18,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2013-10-31 16:14:18,333 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55516, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_936374191023625769_1241, duration: 265188
2013-10-31 16:14:18,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2013-10-31 16:14:18,336 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55517, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3252984414706521299_1241, duration: 270755
2013-10-31 16:14:18,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2013-10-31 16:14:18,339 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55518, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8273281274980003916_1242, duration: 278416
2013-10-31 16:14:18,348 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:14:18,349 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:14:18,369 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:14:18,369 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:14:18,370 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:14:18,370 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself"]
2013-10-31 16:14:18,370 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:14:18,370 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 2
2013-10-31 16:14:18,370 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 2
2013-10-31 16:14:18,372 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2)
2013-10-31 16:14:18,377 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:14:18,377 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:14:18,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:18,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:14:18,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,401 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar. blk_3030443344262937130_1244
2013-10-31 16:14:18,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3030443344262937130_1244 src: /127.0.0.1:48516 dest: /127.0.0.1:47311
2013-10-31 16:14:18,404 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3030443344262937130_1244 src: /127.0.0.1:55520 dest: /127.0.0.1:41648
2013-10-31 16:14:18,405 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3030443344262937130_1244 src: /127.0.0.1:35416 dest: /127.0.0.1:50942
2013-10-31 16:14:18,413 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35416, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3030443344262937130_1244, duration: 5335564
2013-10-31 16:14:18,413 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3030443344262937130_1244 terminating
2013-10-31 16:14:18,413 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8994134656658539248_1233 file build/test/data/dfs/data/data3/current/blk_-8994134656658539248 for deletion
2013-10-31 16:14:18,413 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55520, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3030443344262937130_1244, duration: 5782898
2013-10-31 16:14:18,414 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8994134656658539248_1233 at file build/test/data/dfs/data/data3/current/blk_-8994134656658539248
2013-10-31 16:14:18,413 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1167122552337763453_1232 file build/test/data/dfs/data/data4/current/blk_-1167122552337763453 for deletion
2013-10-31 16:14:18,414 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3030443344262937130_1244 terminating
2013-10-31 16:14:18,414 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1167122552337763453_1232 at file build/test/data/dfs/data/data4/current/blk_-1167122552337763453
2013-10-31 16:14:18,414 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-783758398959565497_1231 file build/test/data/dfs/data/data3/current/blk_-783758398959565497 for deletion
2013-10-31 16:14:18,414 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48516, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3030443344262937130_1244, duration: 6436638
2013-10-31 16:14:18,415 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-783758398959565497_1231 at file build/test/data/dfs/data/data3/current/blk_-783758398959565497
2013-10-31 16:14:18,415 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3030443344262937130_1244 terminating
2013-10-31 16:14:18,415 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1512274723573382003_1234 file build/test/data/dfs/data/data4/current/blk_1512274723573382003 for deletion
2013-10-31 16:14:18,414 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3030443344262937130_1244 size 238055
2013-10-31 16:14:18,416 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1512274723573382003_1234 at file build/test/data/dfs/data/data4/current/blk_1512274723573382003
2013-10-31 16:14:18,416 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6670313106925088236_1237 file build/test/data/dfs/data/data4/current/blk_6670313106925088236 for deletion
2013-10-31 16:14:18,417 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar from client DFSClient_1457307213
2013-10-31 16:14:18,417 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6670313106925088236_1237 at file build/test/data/dfs/data/data4/current/blk_6670313106925088236
2013-10-31 16:14:18,418 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar is closed by DFSClient_1457307213
2013-10-31 16:14:18,418 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3030443344262937130_1244 size 238055
2013-10-31 16:14:18,419 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3030443344262937130_1244 size 238055
2013-10-31 16:14:18,427 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar. New replication is 10
2013-10-31 16:14:18,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar	dst=null	perm=null
2013-10-31 16:14:18,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,441 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:14:18,443 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:14:18,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:18,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,456 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split. New replication is 10
2013-10-31 16:14:18,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split	dst=null	perm=null
2013-10-31 16:14:18,463 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split. blk_-5412770078617130947_1245
2013-10-31 16:14:18,465 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5412770078617130947_1245 src: /127.0.0.1:35417 dest: /127.0.0.1:50942
2013-10-31 16:14:18,467 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5412770078617130947_1245 src: /127.0.0.1:55523 dest: /127.0.0.1:41648
2013-10-31 16:14:18,468 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5412770078617130947_1245 src: /127.0.0.1:48521 dest: /127.0.0.1:47311
2013-10-31 16:14:18,470 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5412770078617130947_1245 src: /127.0.0.1:35489 dest: /127.0.0.1:38271
2013-10-31 16:14:18,473 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35489, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5412770078617130947_1245, duration: 82208
2013-10-31 16:14:18,473 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5412770078617130947_1245 terminating
2013-10-31 16:14:18,474 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48521, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5412770078617130947_1245, duration: 804315
2013-10-31 16:14:18,474 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5412770078617130947_1245 terminating
2013-10-31 16:14:18,475 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55523, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5412770078617130947_1245, duration: 1818589
2013-10-31 16:14:18,475 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5412770078617130947_1245 size 1732
2013-10-31 16:14:18,475 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5412770078617130947_1245 terminating
2013-10-31 16:14:18,476 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35417, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5412770078617130947_1245, duration: 2601277
2013-10-31 16:14:18,476 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5412770078617130947_1245 terminating
2013-10-31 16:14:18,477 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5412770078617130947_1245 size 1732
2013-10-31 16:14:18,478 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split from client DFSClient_1457307213
2013-10-31 16:14:18,478 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split is closed by DFSClient_1457307213
2013-10-31 16:14:18,479 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5412770078617130947_1245 size 1732
2013-10-31 16:14:18,480 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5412770078617130947_1245 size 1732
2013-10-31 16:14:18,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,496 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo. blk_4201116548825547386_1246
2013-10-31 16:14:18,497 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4201116548825547386_1246 src: /127.0.0.1:35490 dest: /127.0.0.1:38271
2013-10-31 16:14:18,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4201116548825547386_1246 src: /127.0.0.1:35422 dest: /127.0.0.1:50942
2013-10-31 16:14:18,501 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4201116548825547386_1246 src: /127.0.0.1:55528 dest: /127.0.0.1:41648
2013-10-31 16:14:18,503 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55528, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4201116548825547386_1246, duration: 978091
2013-10-31 16:14:18,504 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4201116548825547386_1246 terminating
2013-10-31 16:14:18,504 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35422, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4201116548825547386_1246, duration: 731085
2013-10-31 16:14:18,505 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4201116548825547386_1246 terminating
2013-10-31 16:14:18,505 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35490, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4201116548825547386_1246, duration: 1574898
2013-10-31 16:14:18,505 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4201116548825547386_1246 size 183
2013-10-31 16:14:18,506 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4201116548825547386_1246 terminating
2013-10-31 16:14:18,511 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4201116548825547386_1246 size 183
2013-10-31 16:14:18,511 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:14:18,512 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:14:18,512 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4201116548825547386_1246 size 183
2013-10-31 16:14:19,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,766 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml. blk_-249330390446619125_1247
2013-10-31 16:14:19,768 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249330390446619125_1247 src: /127.0.0.1:35424 dest: /127.0.0.1:50942
2013-10-31 16:14:19,770 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249330390446619125_1247 src: /127.0.0.1:35494 dest: /127.0.0.1:38271
2013-10-31 16:14:19,771 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249330390446619125_1247 src: /127.0.0.1:48528 dest: /127.0.0.1:47311
2013-10-31 16:14:19,774 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48528, dest: /127.0.0.1:47311, bytes: 27399, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-249330390446619125_1247, duration: 144023
2013-10-31 16:14:19,774 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-249330390446619125_1247 terminating
2013-10-31 16:14:19,775 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35494, dest: /127.0.0.1:38271, bytes: 27399, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-249330390446619125_1247, duration: 918845
2013-10-31 16:14:19,775 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-249330390446619125_1247 terminating
2013-10-31 16:14:19,776 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35424, dest: /127.0.0.1:50942, bytes: 27399, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-249330390446619125_1247, duration: 1849156
2013-10-31 16:14:19,776 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-249330390446619125_1247 size 27399
2013-10-31 16:14:19,776 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-249330390446619125_1247 terminating
2013-10-31 16:14:19,779 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-249330390446619125_1247 size 27399
2013-10-31 16:14:19,779 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml from client DFSClient_1457307213
2013-10-31 16:14:19,780 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml is closed by DFSClient_1457307213
2013-10-31 16:14:19,780 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-249330390446619125_1247 size 27399
2013-10-31 16:14:19,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml	dst=null	perm=null
2013-10-31 16:14:19,795 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35428, bytes: 27615, op: HDFS_READ, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-249330390446619125_1247, duration: 431342
2013-10-31 16:14:19,813 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0022: nMaps=5 nReduces=0 max=-1
2013-10-31 16:14:19,814 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0022 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:14:19,814 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0022
2013-10-31 16:14:19,814 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0022	RESULT=SUCCESS
2013-10-31 16:14:19,814 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0022
2013-10-31 16:14:19,815 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0022
2013-10-31 16:14:19,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,852 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_conf.xml. blk_494178843268810844_1249
2013-10-31 16:14:19,853 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_494178843268810844_1249 src: /127.0.0.1:35498 dest: /127.0.0.1:38271
2013-10-31 16:14:19,855 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_494178843268810844_1249 src: /127.0.0.1:55535 dest: /127.0.0.1:41648
2013-10-31 16:14:19,857 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_494178843268810844_1249 src: /127.0.0.1:48533 dest: /127.0.0.1:47311
2013-10-31 16:14:19,864 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48533, dest: /127.0.0.1:47311, bytes: 27464, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_494178843268810844_1249, duration: 6378221
2013-10-31 16:14:19,865 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_494178843268810844_1249 terminating
2013-10-31 16:14:19,865 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_494178843268810844_1249 size 27464
2013-10-31 16:14:19,865 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55535, dest: /127.0.0.1:41648, bytes: 27464, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_494178843268810844_1249, duration: 2198076
2013-10-31 16:14:19,866 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_494178843268810844_1249 terminating
2013-10-31 16:14:19,867 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35498, dest: /127.0.0.1:38271, bytes: 27464, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_494178843268810844_1249, duration: 3828305
2013-10-31 16:14:19,867 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_494178843268810844_1249 terminating
2013-10-31 16:14:19,869 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_conf.xml from client DFSClient_1306363302
2013-10-31 16:14:19,869 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_conf.xml is closed by DFSClient_1306363302
2013-10-31 16:14:19,870 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_494178843268810844_1249 size 27464
2013-10-31 16:14:19,870 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_494178843268810844_1249 size 27464
2013-10-31 16:14:19,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,883 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken. blk_-5171279128071141564_1250
2013-10-31 16:14:19,884 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5171279128071141564_1250 src: /127.0.0.1:35501 dest: /127.0.0.1:38271
2013-10-31 16:14:19,886 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5171279128071141564_1250 src: /127.0.0.1:48535 dest: /127.0.0.1:47311
2013-10-31 16:14:19,887 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5171279128071141564_1250 src: /127.0.0.1:55539 dest: /127.0.0.1:41648
2013-10-31 16:14:19,890 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55539, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5171279128071141564_1250, duration: 62665
2013-10-31 16:14:19,891 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5171279128071141564_1250 terminating
2013-10-31 16:14:19,891 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48535, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5171279128071141564_1250, duration: 957144
2013-10-31 16:14:19,892 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5171279128071141564_1250 terminating
2013-10-31 16:14:19,892 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35501, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5171279128071141564_1250, duration: 1805995
2013-10-31 16:14:19,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5171279128071141564_1250 terminating
2013-10-31 16:14:19,895 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5171279128071141564_1250 size 116
2013-10-31 16:14:19,896 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5171279128071141564_1250 size 116
2013-10-31 16:14:19,896 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5171279128071141564_1250 size 116
2013-10-31 16:14:20,296 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken from client DFSClient_1457307213
2013-10-31 16:14:20,297 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken is closed by DFSClient_1457307213
2013-10-31 16:14:20,302 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken
2013-10-31 16:14:20,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:14:20,307 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35435, bytes: 187, op: HDFS_READ, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4201116548825547386_1246, duration: 353203
2013-10-31 16:14:20,308 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0022 = 19. Number of splits = 5
2013-10-31 16:14:20,308 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,310 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,310 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,310 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,310 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,311 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,311 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,311 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,311 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,312 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,312 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0022 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:14:20,312 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0022 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:14:20,406 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0022_m_000006_0' to tip task_20131031160444934_0022_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:20,411 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000004_0'
2013-10-31 16:14:20,413 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:14:20,414 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000006_0 which needs 1 slots
2013-10-31 16:14:20,414 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000006_0 which needs 1 slots
2013-10-31 16:14:20,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken	dst=null	perm=null
2013-10-31 16:14:20,422 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55541, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5171279128071141564_1250, duration: 301158
2013-10-31 16:14:20,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml	dst=null	perm=null
2013-10-31 16:14:20,432 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48540, bytes: 27615, op: HDFS_READ, cliID: DFSClient_-1302019940, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-249330390446619125_1247, duration: 389043
2013-10-31 16:14:20,463 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:20,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar	dst=null	perm=null
2013-10-31 16:14:20,491 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55544, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1302019940, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3030443344262937130_1244, duration: 1056060
2013-10-31 16:14:20,577 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_-1610034685
2013-10-31 16:14:20,577 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_-1610034685 spawned.
2013-10-31 16:14:20,578 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000006_0/taskjvm.sh
2013-10-31 16:14:20,815 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8994134656658539248_1233 file build/test/data/dfs/data/data2/current/blk_-8994134656658539248 for deletion
2013-10-31 16:14:20,815 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1167122552337763453_1232 file build/test/data/dfs/data/data1/current/blk_-1167122552337763453 for deletion
2013-10-31 16:14:20,815 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8994134656658539248_1233 at file build/test/data/dfs/data/data2/current/blk_-8994134656658539248
2013-10-31 16:14:20,816 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-783758398959565497_1231 file build/test/data/dfs/data/data2/current/blk_-783758398959565497 for deletion
2013-10-31 16:14:20,816 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1167122552337763453_1232 at file build/test/data/dfs/data/data1/current/blk_-1167122552337763453
2013-10-31 16:14:20,816 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1512274723573382003_1234 file build/test/data/dfs/data/data1/current/blk_1512274723573382003 for deletion
2013-10-31 16:14:20,816 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-783758398959565497_1231 at file build/test/data/dfs/data/data2/current/blk_-783758398959565497
2013-10-31 16:14:20,816 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6670313106925088236_1237 file build/test/data/dfs/data/data1/current/blk_6670313106925088236 for deletion
2013-10-31 16:14:20,817 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1512274723573382003_1234 at file build/test/data/dfs/data/data1/current/blk_1512274723573382003
2013-10-31 16:14:20,817 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6670313106925088236_1237 at file build/test/data/dfs/data/data1/current/blk_6670313106925088236
2013-10-31 16:14:21,093 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0021
2013-10-31 16:14:21,093 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0021 being deleted.
2013-10-31 16:14:21,199 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000000_0'
2013-10-31 16:14:21,199 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000001_0'
2013-10-31 16:14:21,199 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000006_0'
2013-10-31 16:14:21,275 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_3030443344262937130_1244 to datanode(s) 127.0.0.1:38271
2013-10-31 16:14:21,276 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_6670313106925088236_1237
2013-10-31 16:14:21,415 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_3030443344262937130_1244 to 127.0.0.1:38271 
2013-10-31 16:14:21,417 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3030443344262937130_1244 src: /127.0.0.1:35509 dest: /127.0.0.1:38271
2013-10-31 16:14:21,417 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_3030443344262937130_1244 to /127.0.0.1:38271
2013-10-31 16:14:21,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3030443344262937130_1244 src: /127.0.0.1:35509 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:14:21,422 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3030443344262937130_1244 size 238055
2013-10-31 16:14:22,028 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6670313106925088236_1237 file build/test/data/dfs/data/data5/current/blk_6670313106925088236 for deletion
2013-10-31 16:14:22,028 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6670313106925088236_1237 at file build/test/data/dfs/data/data5/current/blk_6670313106925088236
2013-10-31 16:14:22,937 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_-1610034685 given task: attempt_20131031160444934_0022_m_000006_0
2013-10-31 16:14:23,251 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0021
2013-10-31 16:14:23,251 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000002_0 not found in cache
2013-10-31 16:14:23,251 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000005_0 not found in cache
2013-10-31 16:14:23,251 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000003_0 not found in cache
2013-10-31 16:14:23,252 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0021 for user-log deletion with retainTimeStamp:1383322463252
2013-10-31 16:14:23,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:23,636 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_-1019684994 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:23,647 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22443 with signal TERM. Exit code 0
2013-10-31 16:14:23,819 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:23,819 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:23,819 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:23,820 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_-1019684994 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:24,086 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_-1214335477 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:24,096 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22473 with signal TERM. Exit code 0
2013-10-31 16:14:24,260 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:24,260 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:24,260 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:24,260 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_-1214335477 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:14:25,414 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0021
2013-10-31 16:14:25,414 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000004_0 not found in cache
2013-10-31 16:14:25,415 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0021 for user-log deletion with retainTimeStamp:1383322465415
2013-10-31 16:14:25,708 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_-170222416 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:25,720 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22614 with signal TERM. Exit code 0
2013-10-31 16:14:25,902 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:25,902 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:25,902 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:25,903 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_-170222416 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:26,200 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0021
2013-10-31 16:14:26,200 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000000_0 not found in cache
2013-10-31 16:14:26,201 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000001_0 not found in cache
2013-10-31 16:14:26,201 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0021 for user-log deletion with retainTimeStamp:1383322466201
2013-10-31 16:14:26,383 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000006_0 0.0% setup
2013-10-31 16:14:26,386 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000006_0 is done.
2013-10-31 16:14:26,386 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000006_0  was -1
2013-10-31 16:14:26,387 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:26,419 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000006_0' has completed task_20131031160444934_0022_m_000006 successfully.
2013-10-31 16:14:26,420 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000000_0' to tip task_20131031160444934_0022_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:26,421 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000000
2013-10-31 16:14:26,421 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000001_0' to tip task_20131031160444934_0022_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:26,421 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000001
2013-10-31 16:14:26,423 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:14:26,424 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:14:26,424 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000000_0 which needs 1 slots
2013-10-31 16:14:26,424 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000000_0 which needs 1 slots
2013-10-31 16:14:26,424 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000001_0 which needs 1 slots
2013-10-31 16:14:26,424 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0022_m_000001_0 which needs 1 slots
2013-10-31 16:14:26,441 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_1814097211 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:26,443 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_-1349535248
2013-10-31 16:14:26,444 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_-1349535248 spawned.
2013-10-31 16:14:26,445 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000000_0/taskjvm.sh
2013-10-31 16:14:26,446 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22390 with signal TERM. Exit code 0
2013-10-31 16:14:26,462 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0022/attempt_20131031160444934_0022_m_000001_0. Attempting to reuse: jvm_20131031160444934_0022_m_-1610034685
2013-10-31 16:14:26,599 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:26,599 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:26,600 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:26,600 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_1814097211 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:26,912 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_1540783417 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:26,920 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22255 with signal TERM. Exit code 0
2013-10-31 16:14:26,944 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_-1610034685 given task: attempt_20131031160444934_0022_m_000001_0
2013-10-31 16:14:27,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split	dst=null	perm=null
2013-10-31 16:14:27,048 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35444, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5412770078617130947_1245, duration: 188943
2013-10-31 16:14:27,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:27,091 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48547, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 418031
2013-10-31 16:14:27,095 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:27,096 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:27,096 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:27,097 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_1540783417 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:14:27,101 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000002_0' to tip task_20131031160444934_0022_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:14:27,101 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000002
2013-10-31 16:14:27,101 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000003_0' to tip task_20131031160444934_0022_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:14:27,101 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000003
2013-10-31 16:14:27,103 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:14:27,104 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:14:27,104 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000002_0 which needs 1 slots
2013-10-31 16:14:27,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:27,104 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000002_0 which needs 1 slots
2013-10-31 16:14:27,104 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000003_0 which needs 1 slots
2013-10-31 16:14:27,104 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0022_m_000003_0 which needs 1 slots
2013-10-31 16:14:27,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken	dst=null	perm=null
2013-10-31 16:14:27,112 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48548, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5171279128071141564_1250, duration: 183179
2013-10-31 16:14:27,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml	dst=null	perm=null
2013-10-31 16:14:27,122 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35518, bytes: 27615, op: HDFS_READ, cliID: DFSClient_-539769386, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-249330390446619125_1247, duration: 387480
2013-10-31 16:14:27,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:27,145 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:27,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar	dst=null	perm=null
2013-10-31 16:14:27,159 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35450, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-539769386, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3030443344262937130_1244, duration: 694045
2013-10-31 16:14:27,205 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000004_0' to tip task_20131031160444934_0022_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:27,205 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000004
2013-10-31 16:14:27,206 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:14:27,206 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000004_0 which needs 1 slots
2013-10-31 16:14:27,206 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000004_0 which needs 1 slots
2013-10-31 16:14:27,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken	dst=null	perm=null
2013-10-31 16:14:27,210 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35520, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5171279128071141564_1250, duration: 140062
2013-10-31 16:14:27,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml	dst=null	perm=null
2013-10-31 16:14:27,214 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_1625766810
2013-10-31 16:14:27,215 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_1625766810 spawned.
2013-10-31 16:14:27,215 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35522, bytes: 27615, op: HDFS_READ, cliID: DFSClient_-57388609, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-249330390446619125_1247, duration: 581142
2013-10-31 16:14:27,215 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_-1787526564
2013-10-31 16:14:27,216 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_-1787526564 spawned.
2013-10-31 16:14:27,217 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000003_0/taskjvm.sh
2013-10-31 16:14:27,217 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000002_0/taskjvm.sh
2013-10-31 16:14:27,288 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_-1349535248 given task: attempt_20131031160444934_0022_m_000000_0
2013-10-31 16:14:27,579 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001. blk_7071146985674685312_1251
2013-10-31 16:14:27,596 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7071146985674685312_1251 src: /127.0.0.1:48556 dest: /127.0.0.1:47311
2013-10-31 16:14:27,604 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:27,605 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7071146985674685312_1251 src: /127.0.0.1:55560 dest: /127.0.0.1:41648
2013-10-31 16:14:27,606 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7071146985674685312_1251 src: /127.0.0.1:35525 dest: /127.0.0.1:38271
2013-10-31 16:14:27,609 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35525, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7071146985674685312_1251, duration: 608755
2013-10-31 16:14:27,609 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7071146985674685312_1251 size 92
2013-10-31 16:14:27,609 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7071146985674685312_1251 terminating
2013-10-31 16:14:27,609 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55560, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7071146985674685312_1251, duration: 1596556
2013-10-31 16:14:27,610 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7071146985674685312_1251 terminating
2013-10-31 16:14:27,610 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48556, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7071146985674685312_1251, duration: 2042807
2013-10-31 16:14:27,610 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7071146985674685312_1251 terminating
2013-10-31 16:14:27,611 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7071146985674685312_1251 size 92
2013-10-31 16:14:27,613 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7071146985674685312_1251 size 92
2013-10-31 16:14:27,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar	dst=null	perm=null
2013-10-31 16:14:27,621 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48559, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-57388609, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3030443344262937130_1244, duration: 847757
2013-10-31 16:14:27,644 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0022_m_000001_0
2013-10-31 16:14:27,644 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0022_m_000001_0
2013-10-31 16:14:27,686 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_1921536696
2013-10-31 16:14:27,686 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:27,687 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_1921536696 spawned.
2013-10-31 16:14:27,687 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000001_0 0.0% 
2013-10-31 16:14:27,688 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000004_0/taskjvm.sh
2013-10-31 16:14:28,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split	dst=null	perm=null
2013-10-31 16:14:28,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48561, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5412770078617130947_1245, duration: 186080
2013-10-31 16:14:28,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:28,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:28,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:28,377 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_1625766810 given task: attempt_20131031160444934_0022_m_000003_0
2013-10-31 16:14:28,394 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35462, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 130544
2013-10-31 16:14:28,398 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000. blk_6836394959299064328_1252
2013-10-31 16:14:28,408 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_-1787526564 given task: attempt_20131031160444934_0022_m_000002_0
2013-10-31 16:14:28,422 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6836394959299064328_1252 src: /127.0.0.1:48565 dest: /127.0.0.1:47311
2013-10-31 16:14:28,423 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6836394959299064328_1252 src: /127.0.0.1:55569 dest: /127.0.0.1:41648
2013-10-31 16:14:28,424 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6836394959299064328_1252 src: /127.0.0.1:35534 dest: /127.0.0.1:38271
2013-10-31 16:14:28,426 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35534, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6836394959299064328_1252, duration: 1139363
2013-10-31 16:14:28,426 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6836394959299064328_1252 terminating
2013-10-31 16:14:28,426 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55569, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6836394959299064328_1252, duration: 1487901
2013-10-31 16:14:28,427 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6836394959299064328_1252 terminating
2013-10-31 16:14:28,427 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48565, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6836394959299064328_1252, duration: 1864182
2013-10-31 16:14:28,427 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6836394959299064328_1252 terminating
2013-10-31 16:14:28,428 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6836394959299064328_1252 size 92
2013-10-31 16:14:28,428 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0022_m_000000_0
2013-10-31 16:14:28,428 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0022_m_000000_0
2013-10-31 16:14:28,428 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6836394959299064328_1252 size 92
2013-10-31 16:14:28,429 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6836394959299064328_1252 size 92
2013-10-31 16:14:28,477 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:28,477 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000000_0 0.0% 
2013-10-31 16:14:28,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split	dst=null	perm=null
2013-10-31 16:14:28,876 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_1921536696 given task: attempt_20131031160444934_0022_m_000004_0
2013-10-31 16:14:28,880 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35469, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5412770078617130947_1245, duration: 160189
2013-10-31 16:14:28,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split	dst=null	perm=null
2013-10-31 16:14:28,909 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48572, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5412770078617130947_1245, duration: 149925
2013-10-31 16:14:28,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:28,919 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48573, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 102740
2013-10-31 16:14:28,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:28,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:28,948 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48574, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 112934
2013-10-31 16:14:28,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:28,960 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_147876096733075238_1135
2013-10-31 16:14:29,194 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003. blk_4171475749075851274_1253
2013-10-31 16:14:29,221 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4171475749075851274_1253 src: /127.0.0.1:48575 dest: /127.0.0.1:47311
2013-10-31 16:14:29,222 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4171475749075851274_1253 src: /127.0.0.1:35543 dest: /127.0.0.1:38271
2013-10-31 16:14:29,222 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4171475749075851274_1253 src: /127.0.0.1:35475 dest: /127.0.0.1:50942
2013-10-31 16:14:29,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35475, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4171475749075851274_1253, duration: 1303915
2013-10-31 16:14:29,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4171475749075851274_1253 terminating
2013-10-31 16:14:29,225 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4171475749075851274_1253 size 92
2013-10-31 16:14:29,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35543, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4171475749075851274_1253, duration: 1408964
2013-10-31 16:14:29,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4171475749075851274_1253 terminating
2013-10-31 16:14:29,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48575, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4171475749075851274_1253, duration: 1973706
2013-10-31 16:14:29,226 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4171475749075851274_1253 terminating
2013-10-31 16:14:29,226 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0022_m_000003_0
2013-10-31 16:14:29,227 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0022_m_000003_0
2013-10-31 16:14:29,227 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4171475749075851274_1253 size 92
2013-10-31 16:14:29,228 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4171475749075851274_1253 size 92
2013-10-31 16:14:29,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:29,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:29,390 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:29,390 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000003_0 0.0% 
2013-10-31 16:14:29,426 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000000_0
2013-10-31 16:14:29,426 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000001_0
2013-10-31 16:14:29,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split	dst=null	perm=null
2013-10-31 16:14:29,437 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48579, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5412770078617130947_1245, duration: 198849
2013-10-31 16:14:29,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:29,476 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35547, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 110906
2013-10-31 16:14:29,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0	dst=null	perm=null
2013-10-31 16:14:29,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:29,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:29,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:29,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0	dst=null	perm=null
2013-10-31 16:14:29,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:29,533 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002. blk_5893390770057608854_1255
2013-10-31 16:14:29,557 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5893390770057608854_1255 src: /127.0.0.1:35479 dest: /127.0.0.1:50942
2013-10-31 16:14:29,558 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5893390770057608854_1255 src: /127.0.0.1:48582 dest: /127.0.0.1:47311
2013-10-31 16:14:29,559 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5893390770057608854_1255 src: /127.0.0.1:35550 dest: /127.0.0.1:38271
2013-10-31 16:14:29,563 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35550, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5893390770057608854_1255, duration: 2111419
2013-10-31 16:14:29,563 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5893390770057608854_1255 terminating
2013-10-31 16:14:29,563 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48582, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5893390770057608854_1255, duration: 3297715
2013-10-31 16:14:29,563 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5893390770057608854_1255 terminating
2013-10-31 16:14:29,564 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35479, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5893390770057608854_1255, duration: 3719378
2013-10-31 16:14:29,564 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5893390770057608854_1255 terminating
2013-10-31 16:14:29,566 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5893390770057608854_1255 size 92
2013-10-31 16:14:29,566 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5893390770057608854_1255 size 92
2013-10-31 16:14:29,568 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5893390770057608854_1255 size 92
2013-10-31 16:14:29,685 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004. blk_-6147278667197761988_1255
2013-10-31 16:14:29,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0	dst=null	perm=null
2013-10-31 16:14:29,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:29,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:29,708 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6147278667197761988_1255 src: /127.0.0.1:55587 dest: /127.0.0.1:41648
2013-10-31 16:14:29,709 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6147278667197761988_1255 src: /127.0.0.1:35483 dest: /127.0.0.1:50942
2013-10-31 16:14:29,710 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6147278667197761988_1255 src: /127.0.0.1:35553 dest: /127.0.0.1:38271
2013-10-31 16:14:29,712 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35553, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6147278667197761988_1255, duration: 1047325
2013-10-31 16:14:29,712 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6147278667197761988_1255 terminating
2013-10-31 16:14:29,712 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35483, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6147278667197761988_1255, duration: 1376559
2013-10-31 16:14:29,712 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6147278667197761988_1255 terminating
2013-10-31 16:14:29,712 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55587, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6147278667197761988_1255, duration: 1735620
2013-10-31 16:14:29,713 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6147278667197761988_1255 terminating
2013-10-31 16:14:29,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0	dst=null	perm=null
2013-10-31 16:14:29,714 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6147278667197761988_1255 size 92
2013-10-31 16:14:29,714 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6147278667197761988_1255 size 92
2013-10-31 16:14:29,717 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6147278667197761988_1255 size 92
2013-10-31 16:14:29,966 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0022_m_000002_0
2013-10-31 16:14:29,967 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0022_m_000002_0
2013-10-31 16:14:30,010 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:30,011 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000001_0 is done.
2013-10-31 16:14:30,012 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000001_0  was -1
2013-10-31 16:14:30,012 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:30,033 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:30,033 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000002_0 0.0% 
2013-10-31 16:14:30,107 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000002_0
2013-10-31 16:14:30,107 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000003_0
2013-10-31 16:14:30,114 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0022_m_000004_0
2013-10-31 16:14:30,114 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0022_m_000004_0
2013-10-31 16:14:30,161 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:30,162 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000004_0 0.0% 
2013-10-31 16:14:30,209 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000004_0
2013-10-31 16:14:30,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0	dst=null	perm=null
2013-10-31 16:14:30,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:30,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:30,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0	dst=null	perm=null
2013-10-31 16:14:31,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0	dst=null	perm=null
2013-10-31 16:14:31,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:31,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:31,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0	dst=null	perm=null
2013-10-31 16:14:31,074 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:14:31,076 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000000_0 is done.
2013-10-31 16:14:31,076 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000000_0  was -1
2013-10-31 16:14:31,076 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:31,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0	dst=null	perm=null
2013-10-31 16:14:31,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:31,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004	dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:31,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0	dst=null	perm=null
2013-10-31 16:14:31,424 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0022_m_000006_0
2013-10-31 16:14:31,424 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0022_m_000006_0
2013-10-31 16:14:31,425 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000006_0 not found in cache
2013-10-31 16:14:31,807 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:31,809 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000003_0 is done.
2013-10-31 16:14:31,809 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000003_0  was -1
2013-10-31 16:14:31,810 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:31,833 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:14:31,835 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000002_0 is done.
2013-10-31 16:14:31,835 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000002_0  was -1
2013-10-31 16:14:31,835 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:32,365 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:14:32,367 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000004_0 is done.
2013-10-31 16:14:32,367 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000004_0  was -1
2013-10-31 16:14:32,367 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:32,428 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000000_0' has completed task_20131031160444934_0022_m_000000 successfully.
2013-10-31 16:14:32,429 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000001_0' has completed task_20131031160444934_0022_m_000001 successfully.
2013-10-31 16:14:33,112 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000002_0' has completed task_20131031160444934_0022_m_000002 successfully.
2013-10-31 16:14:33,113 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000003_0' has completed task_20131031160444934_0022_m_000003 successfully.
2013-10-31 16:14:33,212 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000004_0' has completed task_20131031160444934_0022_m_000004 successfully.
2013-10-31 16:14:33,215 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0022_m_000005_0' to tip task_20131031160444934_0022_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:33,218 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:14:33,218 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000005_0 which needs 1 slots
2013-10-31 16:14:33,218 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000005_0 which needs 1 slots
2013-10-31 16:14:33,246 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_1713633212
2013-10-31 16:14:33,247 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_1713633212 spawned.
2013-10-31 16:14:33,250 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000005_0/taskjvm.sh
2013-10-31 16:14:34,351 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_1713633212 given task: attempt_20131031160444934_0022_m_000005_0
2013-10-31 16:14:34,845 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000005_0 0.0% 
2013-10-31 16:14:34,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary	dst=null	perm=null
2013-10-31 16:14:34,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:34,866 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_SUCCESS from client DFSClient_attempt_20131031160444934_0022_m_000005_0
2013-10-31 16:14:34,866 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0022_m_000005_0
2013-10-31 16:14:34,870 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3030443344262937130 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3030443344262937130 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3030443344262937130 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3030443344262937130 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5412770078617130947 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5412770078617130947 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5412770078617130947 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5412770078617130947 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4201116548825547386 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4201116548825547386 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:34,872 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4201116548825547386 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:34,872 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-249330390446619125 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:34,872 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-249330390446619125 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:34,872 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-249330390446619125 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:34,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022	dst=null	perm=null
2013-10-31 16:14:36,278 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-5412770078617130947_1245 blk_4201116548825547386_1246 blk_3030443344262937130_1244
2013-10-31 16:14:36,278 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-5412770078617130947_1245 blk_-249330390446619125_1247 blk_3030443344262937130_1244
2013-10-31 16:14:36,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5412770078617130947_1245 file build/test/data/dfs/data/data3/current/blk_-5412770078617130947 for deletion
2013-10-31 16:14:36,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-249330390446619125_1247 file build/test/data/dfs/data/data4/current/blk_-249330390446619125 for deletion
2013-10-31 16:14:36,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5412770078617130947_1245 at file build/test/data/dfs/data/data3/current/blk_-5412770078617130947
2013-10-31 16:14:36,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3030443344262937130_1244 file build/test/data/dfs/data/data4/current/blk_3030443344262937130 for deletion
2013-10-31 16:14:36,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-249330390446619125_1247 at file build/test/data/dfs/data/data4/current/blk_-249330390446619125
2013-10-31 16:14:36,421 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3030443344262937130_1244 at file build/test/data/dfs/data/data4/current/blk_3030443344262937130
2013-10-31 16:14:37,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5412770078617130947_1245 file build/test/data/dfs/data/data6/current/blk_-5412770078617130947 for deletion
2013-10-31 16:14:37,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3030443344262937130_1244 file build/test/data/dfs/data/data5/current/blk_3030443344262937130 for deletion
2013-10-31 16:14:37,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5412770078617130947_1245 at file build/test/data/dfs/data/data6/current/blk_-5412770078617130947
2013-10-31 16:14:37,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4201116548825547386_1246 file build/test/data/dfs/data/data5/current/blk_4201116548825547386 for deletion
2013-10-31 16:14:37,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3030443344262937130_1244 at file build/test/data/dfs/data/data5/current/blk_3030443344262937130
2013-10-31 16:14:37,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4201116548825547386_1246 at file build/test/data/dfs/data/data5/current/blk_4201116548825547386
2013-10-31 16:14:37,780 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000005_0 0.0% cleanup
2013-10-31 16:14:37,781 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000005_0 is done.
2013-10-31 16:14:37,782 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000005_0  was -1
2013-10-31 16:14:37,782 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:39,224 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000005_0' has completed task_20131031160444934_0022_m_000005 successfully.
2013-10-31 16:14:39,225 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0022 has completed successfully.
2013-10-31 16:14:39,226 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0022,submitTime=1383236059784,launchTime=1383236060312,firstMapTaskLaunchTime=1383236066420,firstJobSetupTaskLaunchTime=1383236060406,firstJobCleanupTaskLaunchTime=1383236073215,finishTime=1383236079225,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5E10CF82AC014665B411915D07D24A73/D543C936A3E14009B56D76795BE5D87E] lower*upper/(2/2)
2013-10-31 16:14:39,231 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009. blk_3293186924092887077_1256
2013-10-31 16:14:39,232 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3293186924092887077_1256 src: /127.0.0.1:55597 dest: /127.0.0.1:41648
2013-10-31 16:14:39,235 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3293186924092887077_1256 src: /127.0.0.1:35562 dest: /127.0.0.1:38271
2013-10-31 16:14:39,236 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3293186924092887077_1256 src: /127.0.0.1:48596 dest: /127.0.0.1:47311
2013-10-31 16:14:39,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48596, dest: /127.0.0.1:47311, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3293186924092887077_1256, duration: 88874
2013-10-31 16:14:39,240 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3293186924092887077_1256 terminating
2013-10-31 16:14:39,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35562, dest: /127.0.0.1:38271, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3293186924092887077_1256, duration: 872112
2013-10-31 16:14:39,241 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3293186924092887077_1256 terminating
2013-10-31 16:14:39,241 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55597, dest: /127.0.0.1:41648, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3293186924092887077_1256, duration: 1798002
2013-10-31 16:14:39,242 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3293186924092887077_1256 terminating
2013-10-31 16:14:39,244 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3293186924092887077_1256 size 26329
2013-10-31 16:14:39,246 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3293186924092887077_1256 size 26329
2013-10-31 16:14:39,247 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009 from client DFSClient_1306363302
2013-10-31 16:14:39,247 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009 is closed by DFSClient_1306363302
2013-10-31 16:14:39,247 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3293186924092887077_1256 size 26329
2013-10-31 16:14:39,279 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-5412770078617130947_1245 blk_-249330390446619125_1247 blk_4201116548825547386_1246 blk_3030443344262937130_1244
2013-10-31 16:14:39,279 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5412770078617130947_1245 blk_-249330390446619125_1247 blk_4201116548825547386_1246 blk_3030443344262937130_1244
2013-10-31 16:14:39,350 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:14:39,351 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000004_0'
2013-10-31 16:14:39,351 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000005_0'
2013-10-31 16:14:39,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5171279128071141564 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:39,353 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0022
2013-10-31 16:14:39,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5171279128071141564 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:39,353 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0022 being deleted.
2013-10-31 16:14:39,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5171279128071141564 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:39,356 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0022_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:14:39,356 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2) ...dedpipesplatform/joinself
2013-10-31 16:14:39,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022	dst=null	perm=null
2013-10-31 16:14:39,364 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:14:39,364 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:14:39,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:39,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:14:39,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,386 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar. blk_3929478301678117236_1257
2013-10-31 16:14:39,387 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3929478301678117236_1257 src: /127.0.0.1:48598 dest: /127.0.0.1:47311
2013-10-31 16:14:39,389 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3929478301678117236_1257 src: /127.0.0.1:35566 dest: /127.0.0.1:38271
2013-10-31 16:14:39,390 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3929478301678117236_1257 src: /127.0.0.1:55603 dest: /127.0.0.1:41648
2013-10-31 16:14:39,400 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55603, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3929478301678117236_1257, duration: 6757973
2013-10-31 16:14:39,401 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3929478301678117236_1257 terminating
2013-10-31 16:14:39,401 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3929478301678117236_1257 size 238055
2013-10-31 16:14:39,401 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35566, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3929478301678117236_1257, duration: 7638719
2013-10-31 16:14:39,402 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3929478301678117236_1257 terminating
2013-10-31 16:14:39,402 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48598, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3929478301678117236_1257, duration: 8565107
2013-10-31 16:14:39,403 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3929478301678117236_1257 terminating
2013-10-31 16:14:39,404 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3929478301678117236_1257 size 238055
2013-10-31 16:14:39,405 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar from client DFSClient_1457307213
2013-10-31 16:14:39,405 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar is closed by DFSClient_1457307213
2013-10-31 16:14:39,406 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3929478301678117236_1257 size 238055
2013-10-31 16:14:39,411 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar. New replication is 10
2013-10-31 16:14:39,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar	dst=null	perm=null
2013-10-31 16:14:39,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,428 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:14:39,434 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:14:39,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:39,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,449 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split. New replication is 10
2013-10-31 16:14:39,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split	dst=null	perm=null
2013-10-31 16:14:39,458 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split. blk_-9000640118742178060_1258
2013-10-31 16:14:39,460 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9000640118742178060_1258 src: /127.0.0.1:35499 dest: /127.0.0.1:50942
2013-10-31 16:14:39,462 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9000640118742178060_1258 src: /127.0.0.1:35569 dest: /127.0.0.1:38271
2013-10-31 16:14:39,463 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9000640118742178060_1258 src: /127.0.0.1:48603 dest: /127.0.0.1:47311
2013-10-31 16:14:39,465 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9000640118742178060_1258 src: /127.0.0.1:55607 dest: /127.0.0.1:41648
2013-10-31 16:14:39,468 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55607, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9000640118742178060_1258, duration: 1714277
2013-10-31 16:14:39,468 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9000640118742178060_1258 terminating
2013-10-31 16:14:39,468 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9000640118742178060_1258 size 1732
2013-10-31 16:14:39,469 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48603, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9000640118742178060_1258, duration: 949802
2013-10-31 16:14:39,469 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-9000640118742178060_1258 size 1732
2013-10-31 16:14:39,469 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9000640118742178060_1258 terminating
2013-10-31 16:14:39,470 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35569, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9000640118742178060_1258, duration: 1926959
2013-10-31 16:14:39,470 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9000640118742178060_1258 terminating
2013-10-31 16:14:39,471 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35499, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9000640118742178060_1258, duration: 2799646
2013-10-31 16:14:39,472 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-9000640118742178060_1258 terminating
2013-10-31 16:14:39,475 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9000640118742178060_1258 size 1732
2013-10-31 16:14:39,475 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split from client DFSClient_1457307213
2013-10-31 16:14:39,476 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split is closed by DFSClient_1457307213
2013-10-31 16:14:39,476 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-9000640118742178060_1258 size 1732
2013-10-31 16:14:39,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,495 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo. blk_6037080951287622233_1259
2013-10-31 16:14:39,496 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6037080951287622233_1259 src: /127.0.0.1:35503 dest: /127.0.0.1:50942
2013-10-31 16:14:39,498 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6037080951287622233_1259 src: /127.0.0.1:55609 dest: /127.0.0.1:41648
2013-10-31 16:14:39,500 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6037080951287622233_1259 src: /127.0.0.1:48607 dest: /127.0.0.1:47311
2013-10-31 16:14:39,502 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48607, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6037080951287622233_1259, duration: 65030
2013-10-31 16:14:39,503 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6037080951287622233_1259 terminating
2013-10-31 16:14:39,503 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55609, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6037080951287622233_1259, duration: 919740
2013-10-31 16:14:39,504 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6037080951287622233_1259 terminating
2013-10-31 16:14:39,504 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6037080951287622233_1259 size 183
2013-10-31 16:14:39,504 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35503, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6037080951287622233_1259, duration: 1724924
2013-10-31 16:14:39,505 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6037080951287622233_1259 terminating
2013-10-31 16:14:39,507 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6037080951287622233_1259 size 183
2013-10-31 16:14:39,507 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:14:39,508 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:14:39,508 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6037080951287622233_1259 size 183
2013-10-31 16:14:39,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,536 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml. blk_4802719476021157792_1260
2013-10-31 16:14:39,537 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4802719476021157792_1260 src: /127.0.0.1:48608 dest: /127.0.0.1:47311
2013-10-31 16:14:39,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4802719476021157792_1260 src: /127.0.0.1:35507 dest: /127.0.0.1:50942
2013-10-31 16:14:39,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4802719476021157792_1260 src: /127.0.0.1:35577 dest: /127.0.0.1:38271
2013-10-31 16:14:39,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35577, dest: /127.0.0.1:38271, bytes: 28509, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4802719476021157792_1260, duration: 80897
2013-10-31 16:14:39,544 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4802719476021157792_1260 terminating
2013-10-31 16:14:39,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35507, dest: /127.0.0.1:50942, bytes: 28509, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4802719476021157792_1260, duration: 845159
2013-10-31 16:14:39,545 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4802719476021157792_1260 terminating
2013-10-31 16:14:39,545 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48608, dest: /127.0.0.1:47311, bytes: 28509, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4802719476021157792_1260, duration: 1681209
2013-10-31 16:14:39,546 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4802719476021157792_1260 size 28509
2013-10-31 16:14:39,546 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4802719476021157792_1260 terminating
2013-10-31 16:14:39,548 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml from client DFSClient_1457307213
2013-10-31 16:14:39,548 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml is closed by DFSClient_1457307213
2013-10-31 16:14:39,548 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4802719476021157792_1260 size 28509
2013-10-31 16:14:39,549 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4802719476021157792_1260 size 28509
2013-10-31 16:14:39,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml	dst=null	perm=null
2013-10-31 16:14:39,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35579, bytes: 28733, op: HDFS_READ, cliID: DFSClient_2026279523, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4802719476021157792_1260, duration: 377087
2013-10-31 16:14:39,581 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0023: nMaps=5 nReduces=0 max=-1
2013-10-31 16:14:39,581 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0023 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:14:39,581 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0023	RESULT=SUCCESS
2013-10-31 16:14:39,581 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0023
2013-10-31 16:14:39,582 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0023
2013-10-31 16:14:39,582 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0023
2013-10-31 16:14:39,848 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:14:39,861 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,866 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,872 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,877 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,883 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,888 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,888 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:14:40,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:40,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:40,095 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_conf.xml. blk_1829214601126488145_1262
2013-10-31 16:14:40,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1829214601126488145_1262 src: /127.0.0.1:35580 dest: /127.0.0.1:38271
2013-10-31 16:14:40,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1829214601126488145_1262 src: /127.0.0.1:48614 dest: /127.0.0.1:47311
2013-10-31 16:14:40,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1829214601126488145_1262 src: /127.0.0.1:55618 dest: /127.0.0.1:41648
2013-10-31 16:14:40,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55618, dest: /127.0.0.1:41648, bytes: 28574, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1829214601126488145_1262, duration: 1179714
2013-10-31 16:14:40,105 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1829214601126488145_1262 terminating
2013-10-31 16:14:40,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48614, dest: /127.0.0.1:47311, bytes: 28574, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1829214601126488145_1262, duration: 1161559
2013-10-31 16:14:40,106 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1829214601126488145_1262 terminating
2013-10-31 16:14:40,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35580, dest: /127.0.0.1:38271, bytes: 28574, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1829214601126488145_1262, duration: 2066913
2013-10-31 16:14:40,107 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1829214601126488145_1262 terminating
2013-10-31 16:14:40,110 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1829214601126488145_1262 size 28574
2013-10-31 16:14:40,110 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_conf.xml from client DFSClient_2026279523
2013-10-31 16:14:40,111 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_conf.xml is closed by DFSClient_2026279523
2013-10-31 16:14:40,111 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1829214601126488145_1262 size 28574
2013-10-31 16:14:40,112 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1829214601126488145_1262 size 28574
2013-10-31 16:14:40,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:40,136 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken. blk_973369226213168052_1263
2013-10-31 16:14:40,138 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_973369226213168052_1263 src: /127.0.0.1:48616 dest: /127.0.0.1:47311
2013-10-31 16:14:40,139 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_973369226213168052_1263 src: /127.0.0.1:35515 dest: /127.0.0.1:50942
2013-10-31 16:14:40,141 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_973369226213168052_1263 src: /127.0.0.1:35585 dest: /127.0.0.1:38271
2013-10-31 16:14:40,144 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35585, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_973369226213168052_1263, duration: 64748
2013-10-31 16:14:40,144 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_973369226213168052_1263 terminating
2013-10-31 16:14:40,144 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35515, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_973369226213168052_1263, duration: 813588
2013-10-31 16:14:40,145 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_973369226213168052_1263 terminating
2013-10-31 16:14:40,145 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48616, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_973369226213168052_1263, duration: 1615069
2013-10-31 16:14:40,146 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_973369226213168052_1263 terminating
2013-10-31 16:14:40,148 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_973369226213168052_1263 size 116
2013-10-31 16:14:40,148 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_973369226213168052_1263 size 116
2013-10-31 16:14:40,149 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken from client DFSClient_1457307213
2013-10-31 16:14:40,149 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken is closed by DFSClient_1457307213
2013-10-31 16:14:40,150 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_973369226213168052_1263 size 116
2013-10-31 16:14:40,159 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken
2013-10-31 16:14:40,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:14:40,163 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55622, bytes: 187, op: HDFS_READ, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6037080951287622233_1259, duration: 266759
2013-10-31 16:14:40,164 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0023 = 19. Number of splits = 5
2013-10-31 16:14:40,165 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,165 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,165 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,165 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,166 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,166 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,166 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,166 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,167 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,167 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,167 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,167 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,168 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,168 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,168 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,168 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0023 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:14:40,169 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0023 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:14:41,449 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0023_m_000006_0' to tip task_20131031160444934_0023_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:41,455 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000000_0'
2013-10-31 16:14:41,455 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000001_0'
2013-10-31 16:14:41,455 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000006_0'
2013-10-31 16:14:41,457 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:14:41,458 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000006_0 which needs 1 slots
2013-10-31 16:14:41,458 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000006_0 which needs 1 slots
2013-10-31 16:14:41,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken	dst=null	perm=null
2013-10-31 16:14:41,467 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35587, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_973369226213168052_1263, duration: 373749
2013-10-31 16:14:41,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml	dst=null	perm=null
2013-10-31 16:14:41,477 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48622, bytes: 28733, op: HDFS_READ, cliID: DFSClient_1722584986, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4802719476021157792_1260, duration: 377698
2013-10-31 16:14:41,503 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:41,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar	dst=null	perm=null
2013-10-31 16:14:41,516 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48623, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1722584986, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3929478301678117236_1257, duration: 599332
2013-10-31 16:14:41,608 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0022_m_-1610034685
2013-10-31 16:14:41,614 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22840 with signal TERM. Exit code 0
2013-10-31 16:14:41,614 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_188051683
2013-10-31 16:14:41,615 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_188051683 spawned.
2013-10-31 16:14:41,617 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000006_0/taskjvm.sh
2013-10-31 16:14:41,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5412770078617130947_1245 file build/test/data/dfs/data/data1/current/blk_-5412770078617130947 for deletion
2013-10-31 16:14:41,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-249330390446619125_1247 file build/test/data/dfs/data/data1/current/blk_-249330390446619125 for deletion
2013-10-31 16:14:41,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5412770078617130947_1245 at file build/test/data/dfs/data/data1/current/blk_-5412770078617130947
2013-10-31 16:14:41,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3030443344262937130_1244 file build/test/data/dfs/data/data2/current/blk_3030443344262937130 for deletion
2013-10-31 16:14:41,823 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-249330390446619125_1247 at file build/test/data/dfs/data/data1/current/blk_-249330390446619125
2013-10-31 16:14:41,823 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4201116548825547386_1246 file build/test/data/dfs/data/data2/current/blk_4201116548825547386 for deletion
2013-10-31 16:14:41,823 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3030443344262937130_1244 at file build/test/data/dfs/data/data2/current/blk_3030443344262937130
2013-10-31 16:14:41,824 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4201116548825547386_1246 at file build/test/data/dfs/data/data2/current/blk_4201116548825547386
2013-10-31 16:14:42,025 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5412770078617130947_1245 file build/test/data/dfs/data/data7/current/blk_-5412770078617130947 for deletion
2013-10-31 16:14:42,025 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-249330390446619125_1247 file build/test/data/dfs/data/data7/current/blk_-249330390446619125 for deletion
2013-10-31 16:14:42,025 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5412770078617130947_1245 at file build/test/data/dfs/data/data7/current/blk_-5412770078617130947
2013-10-31 16:14:42,025 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3030443344262937130_1244 file build/test/data/dfs/data/data8/current/blk_3030443344262937130 for deletion
2013-10-31 16:14:42,026 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-249330390446619125_1247 at file build/test/data/dfs/data/data7/current/blk_-249330390446619125
2013-10-31 16:14:42,026 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4201116548825547386_1246 file build/test/data/dfs/data/data8/current/blk_4201116548825547386 for deletion
2013-10-31 16:14:42,026 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3030443344262937130_1244 at file build/test/data/dfs/data/data8/current/blk_3030443344262937130
2013-10-31 16:14:42,027 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4201116548825547386_1246 at file build/test/data/dfs/data/data8/current/blk_4201116548825547386
2013-10-31 16:14:42,128 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000002_0'
2013-10-31 16:14:42,129 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000003_0'
2013-10-31 16:14:42,280 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_3929478301678117236_1257 to datanode(s) 127.0.0.1:50942
2013-10-31 16:14:42,280 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5171279128071141564_1250
2013-10-31 16:14:42,280 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-5171279128071141564_1250
2013-10-31 16:14:42,422 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_3929478301678117236_1257 to 127.0.0.1:50942 
2013-10-31 16:14:42,422 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5171279128071141564_1250 file build/test/data/dfs/data/data4/current/blk_-5171279128071141564 for deletion
2013-10-31 16:14:42,423 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5171279128071141564_1250 at file build/test/data/dfs/data/data4/current/blk_-5171279128071141564
2013-10-31 16:14:42,424 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3929478301678117236_1257 src: /127.0.0.1:35522 dest: /127.0.0.1:50942
2013-10-31 16:14:42,424 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_3929478301678117236_1257 to /127.0.0.1:50942
2013-10-31 16:14:42,427 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3929478301678117236_1257 src: /127.0.0.1:35522 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:14:42,429 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3929478301678117236_1257 size 238055
2013-10-31 16:14:42,544 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0022_m_-1610034685
2013-10-31 16:14:42,979 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:42,979 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:42,980 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:42,980 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_-1610034685 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:14:43,613 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_188051683 given task: attempt_20131031160444934_0023_m_000006_0
2013-10-31 16:14:44,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:44,353 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0022
2013-10-31 16:14:44,353 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000005_0 not found in cache
2013-10-31 16:14:44,354 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000004_0 not found in cache
2013-10-31 16:14:44,354 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0022 for user-log deletion with retainTimeStamp:1383322484354
2013-10-31 16:14:44,823 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5171279128071141564_1250 file build/test/data/dfs/data/data1/current/blk_-5171279128071141564 for deletion
2013-10-31 16:14:44,823 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5171279128071141564_1250 at file build/test/data/dfs/data/data1/current/blk_-5171279128071141564
2013-10-31 16:14:44,941 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_1921536696 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:44,952 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23155 with signal TERM. Exit code 0
2013-10-31 16:14:45,134 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:45,134 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:45,134 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:45,135 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_1921536696 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:45,281 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-5171279128071141564_1250
2013-10-31 16:14:45,845 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_1713633212 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:45,855 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23324 with signal TERM. Exit code 0
2013-10-31 16:14:46,026 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:46,027 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:46,027 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:46,027 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_1713633212 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:46,036 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5171279128071141564_1250 file build/test/data/dfs/data/data5/current/blk_-5171279128071141564 for deletion
2013-10-31 16:14:46,036 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5171279128071141564_1250 at file build/test/data/dfs/data/data5/current/blk_-5171279128071141564
2013-10-31 16:14:46,458 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0022
2013-10-31 16:14:46,458 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000001_0 not found in cache
2013-10-31 16:14:46,459 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000000_0 not found in cache
2013-10-31 16:14:46,459 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0022 for user-log deletion with retainTimeStamp:1383322486459
2013-10-31 16:14:46,656 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_-1349535248 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:46,665 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22959 with signal TERM. Exit code 0
2013-10-31 16:14:46,860 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:46,860 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:46,860 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:46,860 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_-1349535248 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:47,031 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000006_0 0.0% setup
2013-10-31 16:14:47,034 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000006_0 is done.
2013-10-31 16:14:47,034 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000006_0  was -1
2013-10-31 16:14:47,035 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:47,129 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0022
2013-10-31 16:14:47,130 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000002_0 not found in cache
2013-10-31 16:14:47,130 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000003_0 not found in cache
2013-10-31 16:14:47,131 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0022 for user-log deletion with retainTimeStamp:1383322487131
2013-10-31 16:14:47,384 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_1625766810 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:47,394 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23062 with signal TERM. Exit code 0
2013-10-31 16:14:47,402 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_-1787526564 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:47,419 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23098 with signal TERM. Exit code 0
2013-10-31 16:14:47,462 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000006_0' has completed task_20131031160444934_0023_m_000006 successfully.
2013-10-31 16:14:47,465 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000000_0' to tip task_20131031160444934_0023_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:47,466 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000000
2013-10-31 16:14:47,466 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000001_0' to tip task_20131031160444934_0023_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:47,466 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000001
2013-10-31 16:14:47,467 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:14:47,467 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:14:47,467 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000000_0 which needs 1 slots
2013-10-31 16:14:47,468 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000000_0 which needs 1 slots
2013-10-31 16:14:47,468 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000001_0 which needs 1 slots
2013-10-31 16:14:47,468 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0023_m_000001_0 which needs 1 slots
2013-10-31 16:14:47,486 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_-450470830
2013-10-31 16:14:47,487 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_-450470830 spawned.
2013-10-31 16:14:47,487 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0023/attempt_20131031160444934_0023_m_000001_0. Attempting to reuse: jvm_20131031160444934_0023_m_188051683
2013-10-31 16:14:47,488 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000000_0/taskjvm.sh
2013-10-31 16:14:47,590 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_188051683 given task: attempt_20131031160444934_0023_m_000001_0
2013-10-31 16:14:47,624 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:47,624 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:47,624 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:47,624 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:47,624 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_1625766810 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:47,624 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:47,624 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:14:47,624 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_-1787526564 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:47,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split	dst=null	perm=null
2013-10-31 16:14:47,709 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48628, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9000640118742178060_1258, duration: 174405
2013-10-31 16:14:47,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:47,749 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35596, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 124730
2013-10-31 16:14:47,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:47,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:48,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=null
2013-10-31 16:14:48,009 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 9
2013-10-31 16:14:48,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:48,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:48,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:48,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:48,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:48,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:48,023 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35597, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6836394959299064328_1252, duration: 126669
2013-10-31 16:14:48,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:48,038 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55634, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7071146985674685312_1251, duration: 99242
2013-10-31 16:14:48,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:48,041 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35530, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5893390770057608854_1255, duration: 98091
2013-10-31 16:14:48,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:48,044 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35600, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4171475749075851274_1253, duration: 98655
2013-10-31 16:14:48,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:48,046 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55637, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6147278667197761988_1255, duration: 97349
2013-10-31 16:14:48,054 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001. blk_-2116960668324569547_1264
2013-10-31 16:14:48,069 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2116960668324569547_1264 src: /127.0.0.1:48635 dest: /127.0.0.1:47311
2013-10-31 16:14:48,070 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2116960668324569547_1264 src: /127.0.0.1:35534 dest: /127.0.0.1:50942
2013-10-31 16:14:48,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2116960668324569547_1264 src: /127.0.0.1:55640 dest: /127.0.0.1:41648
2013-10-31 16:14:48,073 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55640, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2116960668324569547_1264, duration: 1291954
2013-10-31 16:14:48,074 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2116960668324569547_1264 terminating
2013-10-31 16:14:48,074 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35534, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2116960668324569547_1264, duration: 1668750
2013-10-31 16:14:48,074 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2116960668324569547_1264 terminating
2013-10-31 16:14:48,074 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48635, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2116960668324569547_1264, duration: 2125147
2013-10-31 16:14:48,075 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2116960668324569547_1264 terminating
2013-10-31 16:14:48,075 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2116960668324569547_1264 size 8
2013-10-31 16:14:48,076 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0023_m_000001_0
2013-10-31 16:14:48,076 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0023_m_000001_0
2013-10-31 16:14:48,077 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2116960668324569547_1264 size 8
2013-10-31 16:14:48,078 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2116960668324569547_1264 size 8
2013-10-31 16:14:48,112 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:48,113 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000001_0 0.0% 
2013-10-31 16:14:48,135 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000002_0' to tip task_20131031160444934_0023_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:14:48,135 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000002
2013-10-31 16:14:48,135 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000003_0' to tip task_20131031160444934_0023_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:14:48,136 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000003
2013-10-31 16:14:48,137 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:14:48,137 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:14:48,137 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000002_0 which needs 1 slots
2013-10-31 16:14:48,137 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000002_0 which needs 1 slots
2013-10-31 16:14:48,137 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000003_0 which needs 1 slots
2013-10-31 16:14:48,138 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0023_m_000003_0 which needs 1 slots
2013-10-31 16:14:48,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken	dst=null	perm=null
2013-10-31 16:14:48,141 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48638, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_973369226213168052_1263, duration: 174925
2013-10-31 16:14:48,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml	dst=null	perm=null
2013-10-31 16:14:48,147 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35607, bytes: 28733, op: HDFS_READ, cliID: DFSClient_1952345195, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4802719476021157792_1260, duration: 220481
2013-10-31 16:14:48,163 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:48,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar	dst=null	perm=null
2013-10-31 16:14:48,177 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55644, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1952345195, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3929478301678117236_1257, duration: 604051
2013-10-31 16:14:48,228 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_1264514395
2013-10-31 16:14:48,228 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_1264514395 spawned.
2013-10-31 16:14:48,228 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_-1577082009
2013-10-31 16:14:48,229 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_-1577082009 spawned.
2013-10-31 16:14:48,230 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000002_0/taskjvm.sh
2013-10-31 16:14:48,230 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000003_0/taskjvm.sh
2013-10-31 16:14:48,361 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000004_0' to tip task_20131031160444934_0023_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:48,362 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000004
2013-10-31 16:14:48,363 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:14:48,363 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000004_0 which needs 1 slots
2013-10-31 16:14:48,363 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000004_0 which needs 1 slots
2013-10-31 16:14:48,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken	dst=null	perm=null
2013-10-31 16:14:48,368 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48643, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_973369226213168052_1263, duration: 129809
2013-10-31 16:14:48,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml	dst=null	perm=null
2013-10-31 16:14:48,374 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35612, bytes: 28733, op: HDFS_READ, cliID: DFSClient_-1036874446, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4802719476021157792_1260, duration: 158067
2013-10-31 16:14:48,387 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_-450470830 given task: attempt_20131031160444934_0023_m_000000_0
2013-10-31 16:14:48,387 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:48,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar	dst=null	perm=null
2013-10-31 16:14:48,401 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48646, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1036874446, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3929478301678117236_1257, duration: 635151
2013-10-31 16:14:48,820 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_-388264292
2013-10-31 16:14:48,821 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_-388264292 spawned.
2013-10-31 16:14:48,822 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000004_0/taskjvm.sh
2013-10-31 16:14:49,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split	dst=null	perm=null
2013-10-31 16:14:49,265 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35546, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9000640118742178060_1258, duration: 161645
2013-10-31 16:14:49,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:49,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:49,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:49,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=null
2013-10-31 16:14:49,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:49,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:49,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:49,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:49,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:49,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:49,543 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48650, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6836394959299064328_1252, duration: 137905
2013-10-31 16:14:49,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:49,561 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48651, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7071146985674685312_1251, duration: 124681
2013-10-31 16:14:49,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:49,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48652, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5893390770057608854_1255, duration: 119922
2013-10-31 16:14:49,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:49,567 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35620, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4171475749075851274_1253, duration: 103782
2013-10-31 16:14:49,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:49,570 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35552, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6147278667197761988_1255, duration: 106037
2013-10-31 16:14:49,573 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35622, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 103582
2013-10-31 16:14:49,580 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000. blk_3615276268400455558_1265
2013-10-31 16:14:49,602 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3615276268400455558_1265 src: /127.0.0.1:48656 dest: /127.0.0.1:47311
2013-10-31 16:14:49,603 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3615276268400455558_1265 src: /127.0.0.1:35624 dest: /127.0.0.1:38271
2013-10-31 16:14:49,604 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3615276268400455558_1265 src: /127.0.0.1:55661 dest: /127.0.0.1:41648
2013-10-31 16:14:49,606 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55661, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3615276268400455558_1265, duration: 1305864
2013-10-31 16:14:49,606 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3615276268400455558_1265 terminating
2013-10-31 16:14:49,607 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35624, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3615276268400455558_1265, duration: 1433145
2013-10-31 16:14:49,607 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3615276268400455558_1265 terminating
2013-10-31 16:14:49,607 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48656, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3615276268400455558_1265, duration: 1948826
2013-10-31 16:14:49,607 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3615276268400455558_1265 terminating
2013-10-31 16:14:49,607 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3615276268400455558_1265 size 8
2013-10-31 16:14:49,608 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_1264514395 given task: attempt_20131031160444934_0023_m_000002_0
2013-10-31 16:14:49,608 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0023_m_000000_0
2013-10-31 16:14:49,609 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0023_m_000000_0
2013-10-31 16:14:49,610 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3615276268400455558_1265 size 8
2013-10-31 16:14:49,611 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3615276268400455558_1265 size 8
2013-10-31 16:14:49,655 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:49,655 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000000_0 0.0% 
2013-10-31 16:14:50,015 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_-1577082009 given task: attempt_20131031160444934_0023_m_000003_0
2013-10-31 16:14:50,016 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_-388264292 given task: attempt_20131031160444934_0023_m_000004_0
2013-10-31 16:14:50,098 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:14:50,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split	dst=null	perm=null
2013-10-31 16:14:50,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55665, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9000640118742178060_1258, duration: 169044
2013-10-31 16:14:50,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:50,144 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48663, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 164372
2013-10-31 16:14:50,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:50,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:50,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=null
2013-10-31 16:14:50,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:50,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:50,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:50,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:50,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:50,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:50,391 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35631, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6836394959299064328_1252, duration: 129520
2013-10-31 16:14:50,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:50,408 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48665, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7071146985674685312_1251, duration: 104193
2013-10-31 16:14:50,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:50,411 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35564, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5893390770057608854_1255, duration: 100712
2013-10-31 16:14:50,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:50,414 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35565, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4171475749075851274_1253, duration: 102638
2013-10-31 16:14:50,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:50,417 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55671, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6147278667197761988_1255, duration: 100898
2013-10-31 16:14:50,425 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002. blk_3089639079467808328_1266
2013-10-31 16:14:50,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3089639079467808328_1266 src: /127.0.0.1:48669 dest: /127.0.0.1:47311
2013-10-31 16:14:50,450 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3089639079467808328_1266 src: /127.0.0.1:55675 dest: /127.0.0.1:41648
2013-10-31 16:14:50,451 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3089639079467808328_1266 src: /127.0.0.1:35571 dest: /127.0.0.1:50942
2013-10-31 16:14:50,453 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35571, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3089639079467808328_1266, duration: 1313560
2013-10-31 16:14:50,453 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3089639079467808328_1266 terminating
2013-10-31 16:14:50,453 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3089639079467808328_1266 size 8
2013-10-31 16:14:50,453 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55675, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3089639079467808328_1266, duration: 1475188
2013-10-31 16:14:50,453 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3089639079467808328_1266 size 8
2013-10-31 16:14:50,453 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3089639079467808328_1266 terminating
2013-10-31 16:14:50,453 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48669, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3089639079467808328_1266, duration: 1933155
2013-10-31 16:14:50,454 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3089639079467808328_1266 size 8
2013-10-31 16:14:50,454 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3089639079467808328_1266 terminating
2013-10-31 16:14:50,455 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0023_m_000002_0
2013-10-31 16:14:50,455 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0023_m_000002_0
2013-10-31 16:14:50,470 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000000_0
2013-10-31 16:14:50,470 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000001_0
2013-10-31 16:14:50,505 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:50,505 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000002_0 0.0% 
2013-10-31 16:14:50,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split	dst=null	perm=null
2013-10-31 16:14:50,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split	dst=null	perm=null
2013-10-31 16:14:50,514 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48674, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9000640118742178060_1258, duration: 200359
2013-10-31 16:14:50,521 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55678, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9000640118742178060_1258, duration: 229361
2013-10-31 16:14:50,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:50,555 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48676, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 102695
2013-10-31 16:14:50,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:14:50,562 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35644, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 228607
2013-10-31 16:14:50,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0	dst=null	perm=null
2013-10-31 16:14:50,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0	dst=null	perm=null
2013-10-31 16:14:51,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,142 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000002_0
2013-10-31 16:14:51,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0	dst=null	perm=null
2013-10-31 16:14:51,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0	dst=null	perm=null
2013-10-31 16:14:51,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0	dst=null	perm=null
2013-10-31 16:14:51,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0	dst=null	perm=null
2013-10-31 16:14:51,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=null
2013-10-31 16:14:51,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:51,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=null
2013-10-31 16:14:51,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:51,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:51,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:51,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:51,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:51,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:51,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:51,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:51,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:51,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:51,638 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48678, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6836394959299064328_1252, duration: 124751
2013-10-31 16:14:51,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000	dst=null	perm=null
2013-10-31 16:14:51,644 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55682, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6836394959299064328_1252, duration: 130061
2013-10-31 16:14:51,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:51,654 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35647, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7071146985674685312_1251, duration: 102538
2013-10-31 16:14:51,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:51,657 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48681, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5893390770057608854_1255, duration: 98567
2013-10-31 16:14:51,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001	dst=null	perm=null
2013-10-31 16:14:51,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:51,661 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35649, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7071146985674685312_1251, duration: 102614
2013-10-31 16:14:51,661 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48683, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4171475749075851274_1253, duration: 111093
2013-10-31 16:14:51,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002	dst=null	perm=null
2013-10-31 16:14:51,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:51,664 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35582, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5893390770057608854_1255, duration: 98451
2013-10-31 16:14:51,664 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35583, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6147278667197761988_1255, duration: 107895
2013-10-31 16:14:51,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003	dst=null	perm=null
2013-10-31 16:14:51,667 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35584, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4171475749075851274_1253, duration: 121749
2013-10-31 16:14:51,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004	dst=null	perm=null
2013-10-31 16:14:51,670 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35654, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6147278667197761988_1255, duration: 101061
2013-10-31 16:14:51,673 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004. blk_-5360327896194444992_1268
2013-10-31 16:14:51,678 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003. blk_-1592307919191127708_1268
2013-10-31 16:14:51,695 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5360327896194444992_1268 src: /127.0.0.1:48688 dest: /127.0.0.1:47311
2013-10-31 16:14:51,696 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5360327896194444992_1268 src: /127.0.0.1:35588 dest: /127.0.0.1:50942
2013-10-31 16:14:51,697 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5360327896194444992_1268 src: /127.0.0.1:35658 dest: /127.0.0.1:38271
2013-10-31 16:14:51,699 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35658, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5360327896194444992_1268, duration: 1054943
2013-10-31 16:14:51,699 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5360327896194444992_1268 terminating
2013-10-31 16:14:51,699 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5360327896194444992_1268 size 8
2013-10-31 16:14:51,699 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35588, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5360327896194444992_1268, duration: 1412992
2013-10-31 16:14:51,700 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5360327896194444992_1268 size 8
2013-10-31 16:14:51,700 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5360327896194444992_1268 terminating
2013-10-31 16:14:51,700 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48688, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5360327896194444992_1268, duration: 1888486
2013-10-31 16:14:51,700 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1592307919191127708_1268 src: /127.0.0.1:35656 dest: /127.0.0.1:38271
2013-10-31 16:14:51,700 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5360327896194444992_1268 terminating
2013-10-31 16:14:51,702 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0023_m_000004_0
2013-10-31 16:14:51,702 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1592307919191127708_1268 src: /127.0.0.1:48692 dest: /127.0.0.1:47311
2013-10-31 16:14:51,702 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0023_m_000004_0
2013-10-31 16:14:51,702 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5360327896194444992_1268 size 8
2013-10-31 16:14:51,703 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1592307919191127708_1268 src: /127.0.0.1:55696 dest: /127.0.0.1:41648
2013-10-31 16:14:51,706 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55696, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1592307919191127708_1268, duration: 1631262
2013-10-31 16:14:51,707 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1592307919191127708_1268 terminating
2013-10-31 16:14:51,707 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48692, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1592307919191127708_1268, duration: 1553836
2013-10-31 16:14:51,708 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1592307919191127708_1268 terminating
2013-10-31 16:14:51,708 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35656, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1592307919191127708_1268, duration: 2622923
2013-10-31 16:14:51,708 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1592307919191127708_1268 terminating
2013-10-31 16:14:51,709 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1592307919191127708_1268 size 8
2013-10-31 16:14:51,710 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0023_m_000003_0
2013-10-31 16:14:51,710 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0023_m_000003_0
2013-10-31 16:14:51,710 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1592307919191127708_1268 size 8
2013-10-31 16:14:51,711 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1592307919191127708_1268 size 8
2013-10-31 16:14:51,772 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:51,772 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:51,772 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000004_0 0.0% 
2013-10-31 16:14:51,772 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000003_0 0.0% 
2013-10-31 16:14:51,825 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:14:51,827 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000000_0 is done.
2013-10-31 16:14:51,827 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000000_0  was -1
2013-10-31 16:14:51,828 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:52,468 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0023_m_000006_0
2013-10-31 16:14:52,468 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0023_m_000006_0
2013-10-31 16:14:52,468 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000006_0 not found in cache
2013-10-31 16:14:53,027 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:14:53,029 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000002_0 is done.
2013-10-31 16:14:53,029 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000002_0  was -1
2013-10-31 16:14:53,030 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:53,474 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000000_0' has completed task_20131031160444934_0023_m_000000 successfully.
2013-10-31 16:14:53,722 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:53,725 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:53,727 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000001_0 is done.
2013-10-31 16:14:53,727 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000001_0  was -1
2013-10-31 16:14:53,727 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:54,145 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000002_0' has completed task_20131031160444934_0023_m_000002 successfully.
2013-10-31 16:14:54,147 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000003_0
2013-10-31 16:14:54,369 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000004_0
2013-10-31 16:14:54,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0	dst=null	perm=null
2013-10-31 16:14:54,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0	dst=null	perm=null
2013-10-31 16:14:54,788 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1426 Total time for transactions(ms): 31Number of transactions batched in Syncs: 150 Number of syncs: 1020 SyncTimes(ms): 45643 8539 
2013-10-31 16:14:54,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:54,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:54,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:54,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:54,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0	dst=null	perm=null
2013-10-31 16:14:54,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0	dst=null	perm=null
2013-10-31 16:14:56,480 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000001_0' has completed task_20131031160444934_0023_m_000001 successfully.
2013-10-31 16:14:56,501 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:56,510 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:56,511 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000003_0 is done.
2013-10-31 16:14:56,511 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000003_0  was -1
2013-10-31 16:14:56,511 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:56,515 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:14:56,522 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:14:56,522 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000004_0 is done.
2013-10-31 16:14:56,523 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000004_0  was -1
2013-10-31 16:14:56,523 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:57,151 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000003_0' has completed task_20131031160444934_0023_m_000003 successfully.
2013-10-31 16:14:57,373 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000004_0' has completed task_20131031160444934_0023_m_000004 successfully.
2013-10-31 16:14:57,375 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0023_m_000005_0' to tip task_20131031160444934_0023_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:57,377 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:14:57,378 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000005_0 which needs 1 slots
2013-10-31 16:14:57,378 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000005_0 which needs 1 slots
2013-10-31 16:14:57,408 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_1581669948
2013-10-31 16:14:57,409 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_1581669948 spawned.
2013-10-31 16:14:57,411 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000005_0/taskjvm.sh
2013-10-31 16:14:58,251 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_1581669948 given task: attempt_20131031160444934_0023_m_000005_0
2013-10-31 16:14:58,767 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000005_0 0.0% 
2013-10-31 16:14:59,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary	dst=null	perm=null
2013-10-31 16:14:59,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:59,084 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_SUCCESS from client DFSClient_attempt_20131031160444934_0023_m_000005_0
2013-10-31 16:14:59,085 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0023_m_000005_0
2013-10-31 16:14:59,091 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3929478301678117236 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:59,092 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3929478301678117236 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:59,092 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3929478301678117236 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:59,092 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3929478301678117236 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:59,092 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9000640118742178060 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:59,092 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9000640118742178060 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:59,093 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9000640118742178060 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:59,093 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9000640118742178060 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:59,093 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6037080951287622233 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:59,093 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6037080951287622233 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:59,094 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6037080951287622233 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:59,094 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4802719476021157792 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:59,094 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4802719476021157792 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:59,094 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4802719476021157792 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:59,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023	dst=null	perm=null
2013-10-31 16:15:00,284 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_4802719476021157792_1260 blk_-9000640118742178060_1258 blk_3929478301678117236_1257
2013-10-31 16:15:00,284 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_4802719476021157792_1260 blk_6037080951287622233_1259 blk_-9000640118742178060_1258 blk_3929478301678117236_1257
2013-10-31 16:15:01,700 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000005_0 0.0% cleanup
2013-10-31 16:15:01,701 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000005_0 is done.
2013-10-31 16:15:01,702 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000005_0  was -1
2013-10-31 16:15:01,702 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:02,829 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9000640118742178060_1258 file build/test/data/dfs/data/data2/current/blk_-9000640118742178060 for deletion
2013-10-31 16:15:02,829 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3929478301678117236_1257 file build/test/data/dfs/data/data1/current/blk_3929478301678117236 for deletion
2013-10-31 16:15:02,830 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9000640118742178060_1258 at file build/test/data/dfs/data/data2/current/blk_-9000640118742178060
2013-10-31 16:15:02,830 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4802719476021157792_1260 file build/test/data/dfs/data/data1/current/blk_4802719476021157792 for deletion
2013-10-31 16:15:02,830 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3929478301678117236_1257 at file build/test/data/dfs/data/data1/current/blk_3929478301678117236
2013-10-31 16:15:02,831 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4802719476021157792_1260 at file build/test/data/dfs/data/data1/current/blk_4802719476021157792
2013-10-31 16:15:03,032 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9000640118742178060_1258 file build/test/data/dfs/data/data7/current/blk_-9000640118742178060 for deletion
2013-10-31 16:15:03,032 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3929478301678117236_1257 file build/test/data/dfs/data/data7/current/blk_3929478301678117236 for deletion
2013-10-31 16:15:03,032 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9000640118742178060_1258 at file build/test/data/dfs/data/data7/current/blk_-9000640118742178060
2013-10-31 16:15:03,032 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4802719476021157792_1260 file build/test/data/dfs/data/data7/current/blk_4802719476021157792 for deletion
2013-10-31 16:15:03,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3929478301678117236_1257 at file build/test/data/dfs/data/data7/current/blk_3929478301678117236
2013-10-31 16:15:03,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6037080951287622233_1259 file build/test/data/dfs/data/data8/current/blk_6037080951287622233 for deletion
2013-10-31 16:15:03,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4802719476021157792_1260 at file build/test/data/dfs/data/data7/current/blk_4802719476021157792
2013-10-31 16:15:03,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6037080951287622233_1259 at file build/test/data/dfs/data/data8/current/blk_6037080951287622233
2013-10-31 16:15:03,284 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_6037080951287622233_1259 blk_-9000640118742178060_1258 blk_3929478301678117236_1257
2013-10-31 16:15:03,285 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_4802719476021157792_1260 blk_6037080951287622233_1259 blk_-9000640118742178060_1258 blk_3929478301678117236_1257
2013-10-31 16:15:03,383 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000005_0' has completed task_20131031160444934_0023_m_000005 successfully.
2013-10-31 16:15:03,384 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0023 has completed successfully.
2013-10-31 16:15:03,385 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0023,submitTime=1383236079555,launchTime=1383236080168,firstMapTaskLaunchTime=1383236087465,firstJobSetupTaskLaunchTime=1383236081448,firstJobCleanupTaskLaunchTime=1383236097375,finishTime=1383236103384,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=41,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5E10CF82AC014665B411915D07D24A73/1E6B46BCFD1C4802A1538AFB49E097CB] lower*upper/(1/2) ...dedpipesplatform/joinself
2013-10-31 16:15:03,390 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802. blk_-4230721372272409284_1269
2013-10-31 16:15:03,391 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230721372272409284_1269 src: /127.0.0.1:35666 dest: /127.0.0.1:38271
2013-10-31 16:15:03,396 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230721372272409284_1269 src: /127.0.0.1:48700 dest: /127.0.0.1:47311
2013-10-31 16:15:03,398 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230721372272409284_1269 src: /127.0.0.1:35599 dest: /127.0.0.1:50942
2013-10-31 16:15:03,410 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35599, dest: /127.0.0.1:50942, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4230721372272409284_1269, duration: 7633540
2013-10-31 16:15:03,410 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4230721372272409284_1269 terminating
2013-10-31 16:15:03,411 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4230721372272409284_1269 size 26341
2013-10-31 16:15:03,411 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48700, dest: /127.0.0.1:47311, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4230721372272409284_1269, duration: 8444595
2013-10-31 16:15:03,411 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4230721372272409284_1269 terminating
2013-10-31 16:15:03,412 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35666, dest: /127.0.0.1:38271, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4230721372272409284_1269, duration: 7703282
2013-10-31 16:15:03,412 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4230721372272409284_1269 terminating
2013-10-31 16:15:03,417 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4230721372272409284_1269 size 26341
2013-10-31 16:15:03,418 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802 from client DFSClient_2026279523
2013-10-31 16:15:03,418 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802 is closed by DFSClient_2026279523
2013-10-31 16:15:03,418 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4230721372272409284_1269 size 26341
2013-10-31 16:15:03,425 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:03,426 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000004_0'
2013-10-31 16:15:03,426 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000005_0'
2013-10-31 16:15:03,428 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_973369226213168052 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,428 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_973369226213168052 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,428 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_973369226213168052 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:03,429 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9000640118742178060_1258 file build/test/data/dfs/data/data3/current/blk_-9000640118742178060 for deletion
2013-10-31 16:15:03,429 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3929478301678117236_1257 file build/test/data/dfs/data/data4/current/blk_3929478301678117236 for deletion
2013-10-31 16:15:03,430 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9000640118742178060_1258 at file build/test/data/dfs/data/data3/current/blk_-9000640118742178060
2013-10-31 16:15:03,430 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4802719476021157792_1260 file build/test/data/dfs/data/data3/current/blk_4802719476021157792 for deletion
2013-10-31 16:15:03,430 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3929478301678117236_1257 at file build/test/data/dfs/data/data4/current/blk_3929478301678117236
2013-10-31 16:15:03,430 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6037080951287622233_1259 file build/test/data/dfs/data/data4/current/blk_6037080951287622233 for deletion
2013-10-31 16:15:03,430 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4802719476021157792_1260 at file build/test/data/dfs/data/data3/current/blk_4802719476021157792
2013-10-31 16:15:03,431 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6037080951287622233_1259 at file build/test/data/dfs/data/data4/current/blk_6037080951287622233
2013-10-31 16:15:03,431 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0023_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:03,434 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3293186924092887077 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,434 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3293186924092887077 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,434 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3293186924092887077 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,434 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_494178843268810844 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_494178843268810844 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_494178843268810844 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6836394959299064328 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,435 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6836394959299064328 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,436 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6836394959299064328 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,436 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7071146985674685312 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,436 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7071146985674685312 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,436 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7071146985674685312 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,437 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5893390770057608854 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,437 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5893390770057608854 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,437 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5893390770057608854 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:03,437 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4171475749075851274 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:03,438 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4171475749075851274 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,438 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4171475749075851274 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,438 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6147278667197761988 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,439 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6147278667197761988 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:03,439 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6147278667197761988 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023	dst=null	perm=null
2013-10-31 16:15:03,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C	dst=null	perm=null
2013-10-31 16:15:03,447 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary
2013-10-31 16:15:03,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself	dst=null	perm=null
2013-10-31 16:15:03,468 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:15:03,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2013-10-31 16:15:03,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2013-10-31 16:15:03,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2013-10-31 16:15:03,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2013-10-31 16:15:03,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2013-10-31 16:15:03,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2013-10-31 16:15:03,479 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55706, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3615276268400455558_1265, duration: 271804
2013-10-31 16:15:03,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2013-10-31 16:15:03,482 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35602, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2116960668324569547_1264, duration: 252400
2013-10-31 16:15:03,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2013-10-31 16:15:03,485 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35603, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3089639079467808328_1266, duration: 252193
2013-10-31 16:15:03,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2013-10-31 16:15:03,488 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55709, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1592307919191127708_1268, duration: 250870
2013-10-31 16:15:03,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2013-10-31 16:15:03,491 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35605, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5360327896194444992_1268, duration: 250074
2013-10-31 16:15:03,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself	dst=null	perm=null
2013-10-31 16:15:03,509 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:15:03,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2013-10-31 16:15:03,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2013-10-31 16:15:03,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2013-10-31 16:15:03,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2013-10-31 16:15:03,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2013-10-31 16:15:03,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2013-10-31 16:15:03,520 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35675, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3615276268400455558_1265, duration: 313224
2013-10-31 16:15:03,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2013-10-31 16:15:03,523 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35607, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2116960668324569547_1264, duration: 265304
2013-10-31 16:15:03,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2013-10-31 16:15:03,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48710, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3089639079467808328_1266, duration: 337978
2013-10-31 16:15:03,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2013-10-31 16:15:03,530 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48711, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1592307919191127708_1268, duration: 251465
2013-10-31 16:15:03,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2013-10-31 16:15:03,533 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35610, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5360327896194444992_1268, duration: 251511
2013-10-31 16:15:03,533 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinself
2013-10-31 16:15:03,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself	dst=null	perm=null
2013-10-31 16:15:03,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2013-10-31 16:15:03,541 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48713, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3615276268400455558_1265, duration: 256026
2013-10-31 16:15:03,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2013-10-31 16:15:03,545 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55717, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2116960668324569547_1264, duration: 260327
2013-10-31 16:15:03,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2013-10-31 16:15:03,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35613, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3089639079467808328_1266, duration: 261105
2013-10-31 16:15:03,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2013-10-31 16:15:03,550 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48716, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1592307919191127708_1268, duration: 265369
2013-10-31 16:15:03,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2013-10-31 16:15:03,553 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35684, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5360327896194444992_1268, duration: 255520
2013-10-31 16:15:03,562 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:15:03,563 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:15:03,594 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] starting
2013-10-31 16:15:03,595 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:15:03,595 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:15:03,595 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:15:03,596 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped"]
2013-10-31 16:15:03,596 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1]  parallel execution is enabled: true
2013-10-31 16:15:03,596 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1]  starting jobs: 2
2013-10-31 16:15:03,596 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1]  allocating threads: 2
2013-10-31 16:15:03,598 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper2*lower*upper1] starting step: (2/2)
2013-10-31 16:15:03,602 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:15:03,602 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:15:03,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:03,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:15:03,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:03,624 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar. blk_8544072883402237301_1270
2013-10-31 16:15:03,625 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8544072883402237301_1270 src: /127.0.0.1:48718 dest: /127.0.0.1:47311
2013-10-31 16:15:03,626 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8544072883402237301_1270 src: /127.0.0.1:35686 dest: /127.0.0.1:38271
2013-10-31 16:15:03,628 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8544072883402237301_1270 src: /127.0.0.1:35618 dest: /127.0.0.1:50942
2013-10-31 16:15:03,636 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35618, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8544072883402237301_1270, duration: 7021964
2013-10-31 16:15:03,636 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8544072883402237301_1270 terminating
2013-10-31 16:15:03,636 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35686, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8544072883402237301_1270, duration: 6227868
2013-10-31 16:15:03,636 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8544072883402237301_1270 terminating
2013-10-31 16:15:03,637 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48718, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8544072883402237301_1270, duration: 6727754
2013-10-31 16:15:03,637 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8544072883402237301_1270 terminating
2013-10-31 16:15:03,639 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8544072883402237301_1270 size 238055
2013-10-31 16:15:03,640 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8544072883402237301_1270 size 238055
2013-10-31 16:15:03,641 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8544072883402237301_1270 size 238055
2013-10-31 16:15:04,039 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar from client DFSClient_1457307213
2013-10-31 16:15:04,039 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar is closed by DFSClient_1457307213
2013-10-31 16:15:04,042 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9000640118742178060_1258 file build/test/data/dfs/data/data5/current/blk_-9000640118742178060 for deletion
2013-10-31 16:15:04,042 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3929478301678117236_1257 file build/test/data/dfs/data/data6/current/blk_3929478301678117236 for deletion
2013-10-31 16:15:04,042 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9000640118742178060_1258 at file build/test/data/dfs/data/data5/current/blk_-9000640118742178060
2013-10-31 16:15:04,042 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6037080951287622233_1259 file build/test/data/dfs/data/data6/current/blk_6037080951287622233 for deletion
2013-10-31 16:15:04,043 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3929478301678117236_1257 at file build/test/data/dfs/data/data6/current/blk_3929478301678117236
2013-10-31 16:15:04,043 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6037080951287622233_1259 at file build/test/data/dfs/data/data6/current/blk_6037080951287622233
2013-10-31 16:15:04,044 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar. New replication is 10
2013-10-31 16:15:04,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar	dst=null	perm=null
2013-10-31 16:15:04,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,054 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:15:04,059 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:15:04,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:15:04,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,072 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split. New replication is 10
2013-10-31 16:15:04,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split	dst=null	perm=null
2013-10-31 16:15:04,385 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split. blk_2440796546292724629_1271
2013-10-31 16:15:04,387 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2440796546292724629_1271 src: /127.0.0.1:48721 dest: /127.0.0.1:47311
2013-10-31 16:15:04,389 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2440796546292724629_1271 src: /127.0.0.1:35620 dest: /127.0.0.1:50942
2013-10-31 16:15:04,390 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2440796546292724629_1271 src: /127.0.0.1:55726 dest: /127.0.0.1:41648
2013-10-31 16:15:04,392 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2440796546292724629_1271 src: /127.0.0.1:35691 dest: /127.0.0.1:38271
2013-10-31 16:15:04,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35691, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2440796546292724629_1271, duration: 88347
2013-10-31 16:15:04,456 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2440796546292724629_1271 terminating
2013-10-31 16:15:04,457 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2440796546292724629_1271 size 1732
2013-10-31 16:15:04,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55726, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2440796546292724629_1271, duration: 882376
2013-10-31 16:15:04,457 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2440796546292724629_1271 size 1732
2013-10-31 16:15:04,458 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2440796546292724629_1271 terminating
2013-10-31 16:15:04,458 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35620, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2440796546292724629_1271, duration: 2033271
2013-10-31 16:15:04,458 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2440796546292724629_1271 size 1732
2013-10-31 16:15:04,458 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2440796546292724629_1271 terminating
2013-10-31 16:15:04,459 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48721, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2440796546292724629_1271, duration: 2904368
2013-10-31 16:15:04,459 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2440796546292724629_1271 terminating
2013-10-31 16:15:04,461 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split from client DFSClient_1457307213
2013-10-31 16:15:04,462 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split is closed by DFSClient_1457307213
2013-10-31 16:15:04,463 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2440796546292724629_1271 size 1732
2013-10-31 16:15:04,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,483 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo. blk_-9086653742670772437_1272
2013-10-31 16:15:04,485 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9086653742670772437_1272 src: /127.0.0.1:35692 dest: /127.0.0.1:38271
2013-10-31 16:15:04,486 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9086653742670772437_1272 src: /127.0.0.1:55729 dest: /127.0.0.1:41648
2013-10-31 16:15:04,487 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9086653742670772437_1272 src: /127.0.0.1:48727 dest: /127.0.0.1:47311
2013-10-31 16:15:04,490 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48727, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9086653742670772437_1272, duration: 61123
2013-10-31 16:15:04,490 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9086653742670772437_1272 terminating
2013-10-31 16:15:04,490 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55729, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9086653742670772437_1272, duration: 820457
2013-10-31 16:15:04,491 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9086653742670772437_1272 size 183
2013-10-31 16:15:04,491 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9086653742670772437_1272 terminating
2013-10-31 16:15:04,491 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35692, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9086653742670772437_1272, duration: 1926318
2013-10-31 16:15:04,492 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-9086653742670772437_1272 size 183
2013-10-31 16:15:04,492 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9086653742670772437_1272 terminating
2013-10-31 16:15:04,494 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:15:04,495 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:15:04,495 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9086653742670772437_1272 size 183
2013-10-31 16:15:04,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:05,948 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000000_0'
2013-10-31 16:15:05,949 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000001_0'
2013-10-31 16:15:05,949 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000006_0'
2013-10-31 16:15:06,161 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000002_0'
2013-10-31 16:15:06,161 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000003_0'
2013-10-31 16:15:06,285 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_8544072883402237301_1270 to datanode(s) 127.0.0.1:41648
2013-10-31 16:15:06,286 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_973369226213168052_1263 blk_5893390770057608854_1255 blk_4171475749075851274_1253 blk_-6147278667197761988_1255
2013-10-31 16:15:06,286 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_494178843268810844_1249 blk_973369226213168052_1263 blk_5893390770057608854_1255 blk_6836394959299064328_1252 blk_4171475749075851274_1253 blk_-6147278667197761988_1255 blk_7071146985674685312_1251 blk_3293186924092887077_1256
2013-10-31 16:15:06,380 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0023
2013-10-31 16:15:06,380 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0023 being deleted.
2013-10-31 16:15:06,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:06,741 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml. blk_-1379367158697454854_1273
2013-10-31 16:15:06,742 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1379367158697454854_1273 src: /127.0.0.1:35697 dest: /127.0.0.1:38271
2013-10-31 16:15:06,742 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1379367158697454854_1273 src: /127.0.0.1:48731 dest: /127.0.0.1:47311
2013-10-31 16:15:06,743 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1379367158697454854_1273 src: /127.0.0.1:55735 dest: /127.0.0.1:41648
2013-10-31 16:15:06,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55735, dest: /127.0.0.1:41648, bytes: 28563, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1379367158697454854_1273, duration: 112793
2013-10-31 16:15:06,745 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1379367158697454854_1273 terminating
2013-10-31 16:15:06,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48731, dest: /127.0.0.1:47311, bytes: 28563, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1379367158697454854_1273, duration: 474050
2013-10-31 16:15:06,745 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1379367158697454854_1273 terminating
2013-10-31 16:15:06,746 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35697, dest: /127.0.0.1:38271, bytes: 28563, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1379367158697454854_1273, duration: 976111
2013-10-31 16:15:06,746 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1379367158697454854_1273 terminating
2013-10-31 16:15:06,747 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1379367158697454854_1273 size 28563
2013-10-31 16:15:06,747 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml from client DFSClient_1457307213
2013-10-31 16:15:06,748 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml is closed by DFSClient_1457307213
2013-10-31 16:15:06,748 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1379367158697454854_1273 size 28563
2013-10-31 16:15:06,748 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1379367158697454854_1273 size 28563
2013-10-31 16:15:06,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml	dst=null	perm=null
2013-10-31 16:15:06,756 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35701, bytes: 28787, op: HDFS_READ, cliID: DFSClient_708454635, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1379367158697454854_1273, duration: 172963
2013-10-31 16:15:06,764 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0024: nMaps=5 nReduces=0 max=-1
2013-10-31 16:15:06,764 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0024 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:15:06,764 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0024
2013-10-31 16:15:06,764 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0024	RESULT=SUCCESS
2013-10-31 16:15:06,764 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0024
2013-10-31 16:15:06,765 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper2*lower*upper1] submitted hadoop job: job_20131031160444934_0024
2013-10-31 16:15:06,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:06,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:06,784 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_conf.xml. blk_8206799160724257515_1275
2013-10-31 16:15:06,785 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8206799160724257515_1275 src: /127.0.0.1:48735 dest: /127.0.0.1:47311
2013-10-31 16:15:06,786 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8206799160724257515_1275 src: /127.0.0.1:35634 dest: /127.0.0.1:50942
2013-10-31 16:15:06,787 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8206799160724257515_1275 src: /127.0.0.1:35704 dest: /127.0.0.1:38271
2013-10-31 16:15:06,789 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35704, dest: /127.0.0.1:38271, bytes: 28628, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8206799160724257515_1275, duration: 91871
2013-10-31 16:15:06,790 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8206799160724257515_1275 terminating
2013-10-31 16:15:06,790 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35634, dest: /127.0.0.1:50942, bytes: 28628, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8206799160724257515_1275, duration: 1470412
2013-10-31 16:15:06,790 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8206799160724257515_1275 terminating
2013-10-31 16:15:06,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48735, dest: /127.0.0.1:47311, bytes: 28628, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8206799160724257515_1275, duration: 1330371
2013-10-31 16:15:06,791 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8206799160724257515_1275 size 28628
2013-10-31 16:15:06,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8206799160724257515_1275 terminating
2013-10-31 16:15:06,793 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_conf.xml from client DFSClient_708454635
2013-10-31 16:15:06,793 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_conf.xml is closed by DFSClient_708454635
2013-10-31 16:15:06,794 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8206799160724257515_1275 size 28628
2013-10-31 16:15:06,794 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8206799160724257515_1275 size 28628
2013-10-31 16:15:06,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:06,805 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken. blk_1994160069267862725_1276
2013-10-31 16:15:06,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1994160069267862725_1276 src: /127.0.0.1:35705 dest: /127.0.0.1:38271
2013-10-31 16:15:06,807 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1994160069267862725_1276 src: /127.0.0.1:35637 dest: /127.0.0.1:50942
2013-10-31 16:15:06,808 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1994160069267862725_1276 src: /127.0.0.1:55743 dest: /127.0.0.1:41648
2013-10-31 16:15:06,810 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55743, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1994160069267862725_1276, duration: 606967
2013-10-31 16:15:06,810 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1994160069267862725_1276 terminating
2013-10-31 16:15:06,810 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35637, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1994160069267862725_1276, duration: 334137
2013-10-31 16:15:06,810 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1994160069267862725_1276 terminating
2013-10-31 16:15:06,810 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1994160069267862725_1276 size 116
2013-10-31 16:15:06,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35705, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1994160069267862725_1276, duration: 702296
2013-10-31 16:15:06,811 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1994160069267862725_1276 terminating
2013-10-31 16:15:06,814 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1994160069267862725_1276 size 116
2013-10-31 16:15:06,814 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken from client DFSClient_1457307213
2013-10-31 16:15:06,815 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken is closed by DFSClient_1457307213
2013-10-31 16:15:06,815 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1994160069267862725_1276 size 116
2013-10-31 16:15:06,819 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken
2013-10-31 16:15:06,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:15:06,822 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55744, bytes: 187, op: HDFS_READ, cliID: DFSClient_708454635, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9086653742670772437_1272, duration: 121179
2013-10-31 16:15:06,823 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0024 = 19. Number of splits = 5
2013-10-31 16:15:06,824 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,824 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,824 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,824 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,826 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,826 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,826 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,826 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,827 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,827 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,827 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0024 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:15:06,828 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0024 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:15:08,428 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0023
2013-10-31 16:15:08,428 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000005_0 not found in cache
2013-10-31 16:15:08,429 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000004_0 not found in cache
2013-10-31 16:15:08,429 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0023 for user-log deletion with retainTimeStamp:1383322508429
2013-10-31 16:15:08,831 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6147278667197761988_1255 file build/test/data/dfs/data/data1/current/blk_-6147278667197761988 for deletion
2013-10-31 16:15:08,831 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_494178843268810844_1249 file build/test/data/dfs/data/data2/current/blk_494178843268810844 for deletion
2013-10-31 16:15:08,831 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6147278667197761988_1255 at file build/test/data/dfs/data/data1/current/blk_-6147278667197761988
2013-10-31 16:15:08,831 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_973369226213168052_1263 file build/test/data/dfs/data/data1/current/blk_973369226213168052 for deletion
2013-10-31 16:15:08,832 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_494178843268810844_1249 at file build/test/data/dfs/data/data2/current/blk_494178843268810844
2013-10-31 16:15:08,832 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_973369226213168052_1263 at file build/test/data/dfs/data/data1/current/blk_973369226213168052
2013-10-31 16:15:08,832 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3293186924092887077_1256 file build/test/data/dfs/data/data2/current/blk_3293186924092887077 for deletion
2013-10-31 16:15:08,833 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4171475749075851274_1253 file build/test/data/dfs/data/data1/current/blk_4171475749075851274 for deletion
2013-10-31 16:15:08,833 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3293186924092887077_1256 at file build/test/data/dfs/data/data2/current/blk_3293186924092887077
2013-10-31 16:15:08,833 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4171475749075851274_1253 at file build/test/data/dfs/data/data1/current/blk_4171475749075851274
2013-10-31 16:15:08,833 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5893390770057608854_1255 file build/test/data/dfs/data/data2/current/blk_5893390770057608854 for deletion
2013-10-31 16:15:08,834 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6836394959299064328_1252 file build/test/data/dfs/data/data2/current/blk_6836394959299064328 for deletion
2013-10-31 16:15:08,834 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5893390770057608854_1255 at file build/test/data/dfs/data/data2/current/blk_5893390770057608854
2013-10-31 16:15:08,834 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7071146985674685312_1251 file build/test/data/dfs/data/data1/current/blk_7071146985674685312 for deletion
2013-10-31 16:15:08,835 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6836394959299064328_1252 at file build/test/data/dfs/data/data2/current/blk_6836394959299064328
2013-10-31 16:15:08,835 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7071146985674685312_1251 at file build/test/data/dfs/data/data1/current/blk_7071146985674685312
2013-10-31 16:15:08,951 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0024_m_000006_0' to tip task_20131031160444934_0024_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:08,954 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:15:08,954 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000006_0 which needs 1 slots
2013-10-31 16:15:08,954 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000006_0 which needs 1 slots
2013-10-31 16:15:08,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken	dst=null	perm=null
2013-10-31 16:15:08,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35709, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1994160069267862725_1276, duration: 137745
2013-10-31 16:15:08,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml	dst=null	perm=null
2013-10-31 16:15:08,962 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48744, bytes: 28787, op: HDFS_READ, cliID: DFSClient_1449557602, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1379367158697454854_1273, duration: 153367
2013-10-31 16:15:08,975 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:08,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar	dst=null	perm=null
2013-10-31 16:15:08,988 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35643, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1449557602, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8544072883402237301_1270, duration: 623052
2013-10-31 16:15:09,033 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_8544072883402237301_1270 to 127.0.0.1:41648 
2013-10-31 16:15:09,033 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6147278667197761988_1255 file build/test/data/dfs/data/data8/current/blk_-6147278667197761988 for deletion
2013-10-31 16:15:09,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_973369226213168052_1263 file build/test/data/dfs/data/data8/current/blk_973369226213168052 for deletion
2013-10-31 16:15:09,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6147278667197761988_1255 at file build/test/data/dfs/data/data8/current/blk_-6147278667197761988
2013-10-31 16:15:09,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4171475749075851274_1253 file build/test/data/dfs/data/data8/current/blk_4171475749075851274 for deletion
2013-10-31 16:15:09,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_973369226213168052_1263 at file build/test/data/dfs/data/data8/current/blk_973369226213168052
2013-10-31 16:15:09,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5893390770057608854_1255 file build/test/data/dfs/data/data7/current/blk_5893390770057608854 for deletion
2013-10-31 16:15:09,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4171475749075851274_1253 at file build/test/data/dfs/data/data8/current/blk_4171475749075851274
2013-10-31 16:15:09,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8544072883402237301_1270 src: /127.0.0.1:55750 dest: /127.0.0.1:41648
2013-10-31 16:15:09,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5893390770057608854_1255 at file build/test/data/dfs/data/data7/current/blk_5893390770057608854
2013-10-31 16:15:09,034 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_8544072883402237301_1270 to /127.0.0.1:41648
2013-10-31 16:15:09,036 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_8544072883402237301_1270 src: /127.0.0.1:55750 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:15:09,037 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8544072883402237301_1270 size 238055
2013-10-31 16:15:09,038 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0023_m_-450470830
2013-10-31 16:15:09,042 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23626 with signal TERM. Exit code 0
2013-10-31 16:15:09,043 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_-14244859
2013-10-31 16:15:09,043 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_-14244859 spawned.
2013-10-31 16:15:09,044 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000006_0/taskjvm.sh
2013-10-31 16:15:09,103 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:09,104 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:09,104 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:09,104 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_-450470830 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:09,287 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_494178843268810844_1249 blk_6836394959299064328_1252 blk_-6147278667197761988_1255 blk_7071146985674685312_1251 blk_3293186924092887077_1256
2013-10-31 16:15:09,287 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_494178843268810844_1249 blk_973369226213168052_1263 blk_5893390770057608854_1255 blk_6836394959299064328_1252 blk_4171475749075851274_1253 blk_7071146985674685312_1251 blk_3293186924092887077_1256
2013-10-31 16:15:09,358 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_-388264292 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:09,368 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23805 with signal TERM. Exit code 0
2013-10-31 16:15:09,431 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_494178843268810844_1249 file build/test/data/dfs/data/data3/current/blk_494178843268810844 for deletion
2013-10-31 16:15:09,431 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_973369226213168052_1263 file build/test/data/dfs/data/data3/current/blk_973369226213168052 for deletion
2013-10-31 16:15:09,431 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_494178843268810844_1249 at file build/test/data/dfs/data/data3/current/blk_494178843268810844
2013-10-31 16:15:09,431 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3293186924092887077_1256 file build/test/data/dfs/data/data3/current/blk_3293186924092887077 for deletion
2013-10-31 16:15:09,432 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_973369226213168052_1263 at file build/test/data/dfs/data/data3/current/blk_973369226213168052
2013-10-31 16:15:09,432 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4171475749075851274_1253 file build/test/data/dfs/data/data3/current/blk_4171475749075851274 for deletion
2013-10-31 16:15:09,432 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3293186924092887077_1256 at file build/test/data/dfs/data/data3/current/blk_3293186924092887077
2013-10-31 16:15:09,432 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5893390770057608854_1255 file build/test/data/dfs/data/data4/current/blk_5893390770057608854 for deletion
2013-10-31 16:15:09,433 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4171475749075851274_1253 at file build/test/data/dfs/data/data3/current/blk_4171475749075851274
2013-10-31 16:15:09,433 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5893390770057608854_1255 at file build/test/data/dfs/data/data4/current/blk_5893390770057608854
2013-10-31 16:15:09,433 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6836394959299064328_1252 file build/test/data/dfs/data/data4/current/blk_6836394959299064328 for deletion
2013-10-31 16:15:09,433 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6836394959299064328_1252 at file build/test/data/dfs/data/data4/current/blk_6836394959299064328
2013-10-31 16:15:09,433 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7071146985674685312_1251 file build/test/data/dfs/data/data3/current/blk_7071146985674685312 for deletion
2013-10-31 16:15:09,434 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7071146985674685312_1251 at file build/test/data/dfs/data/data3/current/blk_7071146985674685312
2013-10-31 16:15:09,540 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:09,540 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:09,540 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:09,540 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_-388264292 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:09,744 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_1581669948 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:09,752 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24005 with signal TERM. Exit code 0
2013-10-31 16:15:09,915 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:09,916 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:09,916 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:09,916 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_1581669948 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:10,043 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6147278667197761988_1255 file build/test/data/dfs/data/data6/current/blk_-6147278667197761988 for deletion
2013-10-31 16:15:10,043 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_494178843268810844_1249 file build/test/data/dfs/data/data6/current/blk_494178843268810844 for deletion
2013-10-31 16:15:10,043 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6147278667197761988_1255 at file build/test/data/dfs/data/data6/current/blk_-6147278667197761988
2013-10-31 16:15:10,043 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3293186924092887077_1256 file build/test/data/dfs/data/data5/current/blk_3293186924092887077 for deletion
2013-10-31 16:15:10,044 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_494178843268810844_1249 at file build/test/data/dfs/data/data6/current/blk_494178843268810844
2013-10-31 16:15:10,044 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6836394959299064328_1252 file build/test/data/dfs/data/data5/current/blk_6836394959299064328 for deletion
2013-10-31 16:15:10,044 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3293186924092887077_1256 at file build/test/data/dfs/data/data5/current/blk_3293186924092887077
2013-10-31 16:15:10,044 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7071146985674685312_1251 file build/test/data/dfs/data/data6/current/blk_7071146985674685312 for deletion
2013-10-31 16:15:10,044 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6836394959299064328_1252 at file build/test/data/dfs/data/data5/current/blk_6836394959299064328
2013-10-31 16:15:10,044 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7071146985674685312_1251 at file build/test/data/dfs/data/data6/current/blk_7071146985674685312
2013-10-31 16:15:10,325 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-14244859 given task: attempt_20131031160444934_0024_m_000006_0
2013-10-31 16:15:10,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:10,949 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0023
2013-10-31 16:15:10,950 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000000_0 not found in cache
2013-10-31 16:15:10,950 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000001_0 not found in cache
2013-10-31 16:15:10,950 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0023 for user-log deletion with retainTimeStamp:1383322510950
2013-10-31 16:15:11,162 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0023
2013-10-31 16:15:11,163 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000003_0 not found in cache
2013-10-31 16:15:11,163 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000002_0 not found in cache
2013-10-31 16:15:11,164 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0023 for user-log deletion with retainTimeStamp:1383322511164
2013-10-31 16:15:11,602 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_1264514395 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:11,613 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23737 with signal TERM. Exit code 0
2013-10-31 16:15:11,819 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:11,820 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:11,820 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:11,820 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_1264514395 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:12,271 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_188051683 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:12,281 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23488 with signal TERM. Exit code 0
2013-10-31 16:15:12,360 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_-1577082009 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:12,365 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23778 with signal TERM. Exit code 0
2013-10-31 16:15:12,446 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:12,446 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:12,446 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:12,447 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_188051683 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:15:12,517 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:12,517 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:12,518 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:12,518 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_-1577082009 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:13,781 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000006_0 0.0% setup
2013-10-31 16:15:13,784 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000006_0 is done.
2013-10-31 16:15:13,784 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000006_0  was -1
2013-10-31 16:15:13,784 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:14,960 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000006_0' has completed task_20131031160444934_0024_m_000006 successfully.
2013-10-31 16:15:14,963 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000000_0' to tip task_20131031160444934_0024_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:14,964 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000000
2013-10-31 16:15:14,965 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000001_0' to tip task_20131031160444934_0024_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:14,965 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000001
2013-10-31 16:15:14,967 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:15:14,969 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:15:14,969 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000000_0 which needs 1 slots
2013-10-31 16:15:14,969 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000000_0 which needs 1 slots
2013-10-31 16:15:14,970 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000001_0 which needs 1 slots
2013-10-31 16:15:14,970 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0024_m_000001_0 which needs 1 slots
2013-10-31 16:15:15,005 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_624470708
2013-10-31 16:15:15,006 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_624470708 spawned.
2013-10-31 16:15:15,009 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000001_0/taskjvm.sh
2013-10-31 16:15:15,012 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0024/attempt_20131031160444934_0024_m_000000_0. Attempting to reuse: jvm_20131031160444934_0024_m_-14244859
2013-10-31 16:15:15,172 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000002_0' to tip task_20131031160444934_0024_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:15,172 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000002
2013-10-31 16:15:15,172 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000003_0' to tip task_20131031160444934_0024_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:15,172 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000003
2013-10-31 16:15:15,173 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:15:15,174 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:15:15,174 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000002_0 which needs 1 slots
2013-10-31 16:15:15,174 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000002_0 which needs 1 slots
2013-10-31 16:15:15,174 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000003_0 which needs 1 slots
2013-10-31 16:15:15,174 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0024_m_000003_0 which needs 1 slots
2013-10-31 16:15:15,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken	dst=null	perm=null
2013-10-31 16:15:15,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35718, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1994160069267862725_1276, duration: 138607
2013-10-31 16:15:15,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml	dst=null	perm=null
2013-10-31 16:15:15,182 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48753, bytes: 28787, op: HDFS_READ, cliID: DFSClient_-1782677983, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1379367158697454854_1273, duration: 202207
2013-10-31 16:15:15,196 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:15,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar	dst=null	perm=null
2013-10-31 16:15:15,215 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35652, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1782677983, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8544072883402237301_1270, duration: 685233
2013-10-31 16:15:15,274 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_-2014524527
2013-10-31 16:15:15,275 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_-2014524527 spawned.
2013-10-31 16:15:15,275 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_-318845689
2013-10-31 16:15:15,275 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_-318845689 spawned.
2013-10-31 16:15:15,276 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000002_0/taskjvm.sh
2013-10-31 16:15:15,276 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000003_0/taskjvm.sh
2013-10-31 16:15:15,351 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-14244859 given task: attempt_20131031160444934_0024_m_000000_0
2013-10-31 16:15:15,388 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000004_0' to tip task_20131031160444934_0024_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:15:15,388 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000004
2013-10-31 16:15:15,389 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:15:15,389 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000004_0 which needs 1 slots
2013-10-31 16:15:15,389 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000004_0 which needs 1 slots
2013-10-31 16:15:15,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken	dst=null	perm=null
2013-10-31 16:15:15,393 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35653, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1994160069267862725_1276, duration: 150482
2013-10-31 16:15:15,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml	dst=null	perm=null
2013-10-31 16:15:15,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35724, bytes: 28787, op: HDFS_READ, cliID: DFSClient_14295467, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1379367158697454854_1273, duration: 161917
2013-10-31 16:15:15,412 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:15,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar	dst=null	perm=null
2013-10-31 16:15:15,427 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35726, bytes: 239915, op: HDFS_READ, cliID: DFSClient_14295467, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8544072883402237301_1270, duration: 751040
2013-10-31 16:15:15,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split	dst=null	perm=null
2013-10-31 16:15:15,457 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35658, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2440796546292724629_1271, duration: 160720
2013-10-31 16:15:15,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:15:15,540 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_-2077162363
2013-10-31 16:15:15,541 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_-2077162363 spawned.
2013-10-31 16:15:15,542 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000004_0/taskjvm.sh
2013-10-31 16:15:15,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:15,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:15,820 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_624470708 given task: attempt_20131031160444934_0024_m_000001_0
2013-10-31 16:15:15,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:15,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:15,959 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35661, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 129767
2013-10-31 16:15:15,963 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48764, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 191105
2013-10-31 16:15:15,969 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000. blk_2623433961007257862_1277
2013-10-31 16:15:15,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2623433961007257862_1277 src: /127.0.0.1:55768 dest: /127.0.0.1:41648
2013-10-31 16:15:15,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2623433961007257862_1277 src: /127.0.0.1:35664 dest: /127.0.0.1:50942
2013-10-31 16:15:15,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2623433961007257862_1277 src: /127.0.0.1:35734 dest: /127.0.0.1:38271
2013-10-31 16:15:15,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35734, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2623433961007257862_1277, duration: 1924981
2013-10-31 16:15:15,997 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2623433961007257862_1277 terminating
2013-10-31 16:15:15,998 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35664, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2623433961007257862_1277, duration: 2345145
2013-10-31 16:15:15,998 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2623433961007257862_1277 terminating
2013-10-31 16:15:15,998 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55768, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2623433961007257862_1277, duration: 2928886
2013-10-31 16:15:15,999 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2623433961007257862_1277 terminating
2013-10-31 16:15:15,999 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2623433961007257862_1277 size 104
2013-10-31 16:15:15,999 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2623433961007257862_1277 size 104
2013-10-31 16:15:16,000 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2623433961007257862_1277 size 104
2013-10-31 16:15:16,000 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0024_m_000000_0
2013-10-31 16:15:16,000 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0024_m_000000_0
2013-10-31 16:15:16,039 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:16,039 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000000_0 0.0% 
2013-10-31 16:15:16,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split	dst=null	perm=null
2013-10-31 16:15:16,330 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-2014524527 given task: attempt_20131031160444934_0024_m_000002_0
2013-10-31 16:15:16,331 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55773, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2440796546292724629_1271, duration: 162069
2013-10-31 16:15:16,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:15:16,370 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35740, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 122314
2013-10-31 16:15:16,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:16,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:16,526 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-318845689 given task: attempt_20131031160444934_0024_m_000003_0
2013-10-31 16:15:16,530 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-2077162363 given task: attempt_20131031160444934_0024_m_000004_0
2013-10-31 16:15:16,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:16,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:16,625 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48774, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 122867
2013-10-31 16:15:16,635 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001. blk_2558601193971908172_1278
2013-10-31 16:15:16,657 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2558601193971908172_1278 src: /127.0.0.1:55778 dest: /127.0.0.1:41648
2013-10-31 16:15:16,658 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2558601193971908172_1278 src: /127.0.0.1:48776 dest: /127.0.0.1:47311
2013-10-31 16:15:16,659 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2558601193971908172_1278 src: /127.0.0.1:35744 dest: /127.0.0.1:38271
2013-10-31 16:15:16,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35744, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2558601193971908172_1278, duration: 1131354
2013-10-31 16:15:16,662 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2558601193971908172_1278 terminating
2013-10-31 16:15:16,662 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48776, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2558601193971908172_1278, duration: 1488949
2013-10-31 16:15:16,662 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2558601193971908172_1278 terminating
2013-10-31 16:15:16,662 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55778, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2558601193971908172_1278, duration: 1860337
2013-10-31 16:15:16,662 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2558601193971908172_1278 terminating
2013-10-31 16:15:16,664 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2558601193971908172_1278 size 104
2013-10-31 16:15:16,665 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2558601193971908172_1278 size 104
2013-10-31 16:15:16,666 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2558601193971908172_1278 size 104
2013-10-31 16:15:16,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split	dst=null	perm=null
2013-10-31 16:15:16,855 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35746, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2440796546292724629_1271, duration: 216871
2013-10-31 16:15:16,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:15:16,896 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35678, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 266045
2013-10-31 16:15:16,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:16,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:17,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split	dst=null	perm=null
2013-10-31 16:15:17,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split	dst=null	perm=null
2013-10-31 16:15:17,032 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48783, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2440796546292724629_1271, duration: 164383
2013-10-31 16:15:17,033 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35682, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2440796546292724629_1271, duration: 138524
2013-10-31 16:15:17,064 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0024_m_000001_0
2013-10-31 16:15:17,065 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0024_m_000001_0
2013-10-31 16:15:17,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:15:17,072 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35683, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 266314
2013-10-31 16:15:17,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:15:17,084 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48786, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 104048
2013-10-31 16:15:17,113 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:17,113 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000001_0 0.0% 
2013-10-31 16:15:17,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:17,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:17,316 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35685, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 289617
2013-10-31 16:15:17,326 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002. blk_-7985283914289950420_1279
2013-10-31 16:15:17,348 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7985283914289950420_1279 src: /127.0.0.1:35755 dest: /127.0.0.1:38271
2013-10-31 16:15:17,356 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7985283914289950420_1279 src: /127.0.0.1:55792 dest: /127.0.0.1:41648
2013-10-31 16:15:17,357 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7985283914289950420_1279 src: /127.0.0.1:35688 dest: /127.0.0.1:50942
2013-10-31 16:15:17,363 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35688, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7985283914289950420_1279, duration: 1504444
2013-10-31 16:15:17,363 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7985283914289950420_1279 terminating
2013-10-31 16:15:17,364 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55792, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7985283914289950420_1279, duration: 4284465
2013-10-31 16:15:17,365 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7985283914289950420_1279 terminating
2013-10-31 16:15:17,365 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35755, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7985283914289950420_1279, duration: 5808381
2013-10-31 16:15:17,365 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7985283914289950420_1279 terminating
2013-10-31 16:15:17,372 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7985283914289950420_1279 size 104
2013-10-31 16:15:17,372 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7985283914289950420_1279 size 104
2013-10-31 16:15:17,372 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7985283914289950420_1279 size 104
2013-10-31 16:15:17,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:17,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:17,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:17,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:17,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:17,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:17,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:17,729 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48791, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 135657
2013-10-31 16:15:17,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:17,733 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48792, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 96210
2013-10-31 16:15:17,739 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003. blk_1719649238952092533_1281
2013-10-31 16:15:17,743 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004. blk_-8601652280056973022_1281
2013-10-31 16:15:17,761 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1719649238952092533_1281 src: /127.0.0.1:55796 dest: /127.0.0.1:41648
2013-10-31 16:15:17,763 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1719649238952092533_1281 src: /127.0.0.1:35762 dest: /127.0.0.1:38271
2013-10-31 16:15:17,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1719649238952092533_1281 src: /127.0.0.1:35694 dest: /127.0.0.1:50942
2013-10-31 16:15:17,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8601652280056973022_1281 src: /127.0.0.1:55797 dest: /127.0.0.1:41648
2013-10-31 16:15:17,767 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8601652280056973022_1281 src: /127.0.0.1:35764 dest: /127.0.0.1:38271
2013-10-31 16:15:17,767 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35694, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1719649238952092533_1281, duration: 1714064
2013-10-31 16:15:17,767 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1719649238952092533_1281 terminating
2013-10-31 16:15:17,767 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1719649238952092533_1281 size 104
2013-10-31 16:15:17,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35762, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1719649238952092533_1281, duration: 1859649
2013-10-31 16:15:17,768 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8601652280056973022_1281 src: /127.0.0.1:35696 dest: /127.0.0.1:50942
2013-10-31 16:15:17,768 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1719649238952092533_1281 terminating
2013-10-31 16:15:17,769 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55796, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1719649238952092533_1281, duration: 2747832
2013-10-31 16:15:17,769 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1719649238952092533_1281 terminating
2013-10-31 16:15:17,770 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1719649238952092533_1281 size 104
2013-10-31 16:15:17,771 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0024_m_000003_0
2013-10-31 16:15:17,771 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0024_m_000003_0
2013-10-31 16:15:17,771 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35696, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8601652280056973022_1281, duration: 1572621
2013-10-31 16:15:17,771 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8601652280056973022_1281 terminating
2013-10-31 16:15:17,772 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35764, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8601652280056973022_1281, duration: 1297963
2013-10-31 16:15:17,772 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8601652280056973022_1281 terminating
2013-10-31 16:15:17,772 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0024_m_000002_0
2013-10-31 16:15:17,773 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0024_m_000002_0
2013-10-31 16:15:17,773 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55797, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8601652280056973022_1281, duration: 2331223
2013-10-31 16:15:17,773 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1719649238952092533_1281 size 104
2013-10-31 16:15:17,773 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8601652280056973022_1281 terminating
2013-10-31 16:15:17,774 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8601652280056973022_1281 size 104
2013-10-31 16:15:17,775 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8601652280056973022_1281 size 104
2013-10-31 16:15:17,775 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0024_m_000004_0
2013-10-31 16:15:17,775 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0024_m_000004_0
2013-10-31 16:15:17,776 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8601652280056973022_1281 size 104
2013-10-31 16:15:17,834 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:17,834 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:17,834 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000004_0 0.0% 
2013-10-31 16:15:17,834 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000003_0 0.0% 
2013-10-31 16:15:17,835 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:17,835 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000002_0 0.0% 
2013-10-31 16:15:17,973 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000000_0
2013-10-31 16:15:17,973 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000001_0
2013-10-31 16:15:18,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0	dst=null	perm=null
2013-10-31 16:15:18,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0	dst=null	perm=null
2013-10-31 16:15:18,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0	dst=null	perm=null
2013-10-31 16:15:18,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0	dst=null	perm=null
2013-10-31 16:15:18,178 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000002_0
2013-10-31 16:15:18,178 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000003_0
2013-10-31 16:15:18,392 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000004_0
2013-10-31 16:15:18,418 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:15:18,420 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000000_0 is done.
2013-10-31 16:15:18,420 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000000_0  was -1
2013-10-31 16:15:18,420 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:15:18,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0	dst=null	perm=null
2013-10-31 16:15:18,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0	dst=null	perm=null
2013-10-31 16:15:18,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0	dst=null	perm=null
2013-10-31 16:15:18,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004	dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0	dst=null	perm=null
2013-10-31 16:15:18,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0	dst=null	perm=null
2013-10-31 16:15:18,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0	dst=null	perm=null
2013-10-31 16:15:19,259 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:15:19,261 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000001_0 is done.
2013-10-31 16:15:19,261 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000001_0  was -1
2013-10-31 16:15:19,261 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:19,781 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:15:19,783 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000002_0 is done.
2013-10-31 16:15:19,783 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000002_0  was -1
2013-10-31 16:15:19,784 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:15:19,957 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:15:19,959 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:15:19,959 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000003_0 is done.
2013-10-31 16:15:19,959 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000003_0  was -1
2013-10-31 16:15:19,960 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:19,960 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000004_0 is done.
2013-10-31 16:15:19,960 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000004_0  was -1
2013-10-31 16:15:19,960 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:19,969 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0024_m_000006_0
2013-10-31 16:15:19,969 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0024_m_000006_0
2013-10-31 16:15:19,970 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000006_0 not found in cache
2013-10-31 16:15:20,978 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000000_0' has completed task_20131031160444934_0024_m_000000 successfully.
2013-10-31 16:15:20,979 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000001_0' has completed task_20131031160444934_0024_m_000001 successfully.
2013-10-31 16:15:21,182 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000002_0' has completed task_20131031160444934_0024_m_000002 successfully.
2013-10-31 16:15:21,183 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000003_0' has completed task_20131031160444934_0024_m_000003 successfully.
2013-10-31 16:15:21,395 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000004_0' has completed task_20131031160444934_0024_m_000004 successfully.
2013-10-31 16:15:21,398 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0024_m_000005_0' to tip task_20131031160444934_0024_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:15:21,402 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:15:21,402 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000005_0 which needs 1 slots
2013-10-31 16:15:21,402 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000005_0 which needs 1 slots
2013-10-31 16:15:21,440 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_543313488
2013-10-31 16:15:21,441 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_543313488 spawned.
2013-10-31 16:15:21,444 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000005_0/taskjvm.sh
2013-10-31 16:15:22,346 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_543313488 given task: attempt_20131031160444934_0024_m_000005_0
2013-10-31 16:15:22,858 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000005_0 0.0% 
2013-10-31 16:15:22,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary	dst=null	perm=null
2013-10-31 16:15:22,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:22,880 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_SUCCESS from client DFSClient_attempt_20131031160444934_0024_m_000005_0
2013-10-31 16:15:22,880 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0024_m_000005_0
2013-10-31 16:15:22,887 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8544072883402237301 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:22,887 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8544072883402237301 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:22,887 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8544072883402237301 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:22,887 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8544072883402237301 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:22,887 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2440796546292724629 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:22,888 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2440796546292724629 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:22,888 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2440796546292724629 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:22,888 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2440796546292724629 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:22,888 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9086653742670772437 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:22,888 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9086653742670772437 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:22,888 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9086653742670772437 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:22,889 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1379367158697454854 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:22,889 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1379367158697454854 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:22,889 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1379367158697454854 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:23,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024	dst=null	perm=null
2013-10-31 16:15:24,290 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-9086653742670772437_1272 blk_2440796546292724629_1271 blk_-1379367158697454854_1273 blk_8544072883402237301_1270
2013-10-31 16:15:24,290 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-9086653742670772437_1272 blk_2440796546292724629_1271 blk_-1379367158697454854_1273 blk_8544072883402237301_1270
2013-10-31 16:15:25,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9086653742670772437_1272 file build/test/data/dfs/data/data5/current/blk_-9086653742670772437 for deletion
2013-10-31 16:15:25,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1379367158697454854_1273 file build/test/data/dfs/data/data6/current/blk_-1379367158697454854 for deletion
2013-10-31 16:15:25,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9086653742670772437_1272 at file build/test/data/dfs/data/data5/current/blk_-9086653742670772437
2013-10-31 16:15:25,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2440796546292724629_1271 file build/test/data/dfs/data/data6/current/blk_2440796546292724629 for deletion
2013-10-31 16:15:25,050 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1379367158697454854_1273 at file build/test/data/dfs/data/data6/current/blk_-1379367158697454854
2013-10-31 16:15:25,050 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8544072883402237301_1270 file build/test/data/dfs/data/data6/current/blk_8544072883402237301 for deletion
2013-10-31 16:15:25,050 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2440796546292724629_1271 at file build/test/data/dfs/data/data6/current/blk_2440796546292724629
2013-10-31 16:15:25,051 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8544072883402237301_1270 at file build/test/data/dfs/data/data6/current/blk_8544072883402237301
2013-10-31 16:15:25,788 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000005_0 0.0% cleanup
2013-10-31 16:15:25,790 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000005_0 is done.
2013-10-31 16:15:25,790 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000005_0  was -1
2013-10-31 16:15:25,790 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:26,837 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9086653742670772437_1272 file build/test/data/dfs/data/data2/current/blk_-9086653742670772437 for deletion
2013-10-31 16:15:26,837 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1379367158697454854_1273 file build/test/data/dfs/data/data1/current/blk_-1379367158697454854 for deletion
2013-10-31 16:15:26,837 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9086653742670772437_1272 at file build/test/data/dfs/data/data2/current/blk_-9086653742670772437
2013-10-31 16:15:26,838 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1379367158697454854_1273 at file build/test/data/dfs/data/data1/current/blk_-1379367158697454854
2013-10-31 16:15:26,838 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2440796546292724629_1271 file build/test/data/dfs/data/data1/current/blk_2440796546292724629 for deletion
2013-10-31 16:15:26,838 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8544072883402237301_1270 file build/test/data/dfs/data/data2/current/blk_8544072883402237301 for deletion
2013-10-31 16:15:26,838 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2440796546292724629_1271 at file build/test/data/dfs/data/data1/current/blk_2440796546292724629
2013-10-31 16:15:26,839 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8544072883402237301_1270 at file build/test/data/dfs/data/data2/current/blk_8544072883402237301
2013-10-31 16:15:27,291 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-9086653742670772437_1272 blk_2440796546292724629_1271 blk_-1379367158697454854_1273 blk_8544072883402237301_1270
2013-10-31 16:15:27,291 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_2440796546292724629_1271 blk_8544072883402237301_1270
2013-10-31 16:15:27,408 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000005_0' has completed task_20131031160444934_0024_m_000005 successfully.
2013-10-31 16:15:27,409 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0024 has completed successfully.
2013-10-31 16:15:27,409 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0024,submitTime=1383236106752,launchTime=1383236106827,firstMapTaskLaunchTime=1383236114963,firstJobSetupTaskLaunchTime=1383236108951,firstJobCleanupTaskLaunchTime=1383236121397,finishTime=1383236127409,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[ED56FF6D03804A6891662367F6814562/5886B95B0336446D9321F550152F5088] upper2*lower*upper1/(2/2)
2013-10-31 16:15:27,417 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D. blk_-750470584501963121_1282
2013-10-31 16:15:27,419 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-750470584501963121_1282 src: /127.0.0.1:35769 dest: /127.0.0.1:38271
2013-10-31 16:15:27,421 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-750470584501963121_1282 src: /127.0.0.1:48803 dest: /127.0.0.1:47311
2013-10-31 16:15:27,423 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-750470584501963121_1282 src: /127.0.0.1:55807 dest: /127.0.0.1:41648
2013-10-31 16:15:27,426 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55807, dest: /127.0.0.1:41648, bytes: 26355, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-750470584501963121_1282, duration: 1380919
2013-10-31 16:15:27,426 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-750470584501963121_1282 terminating
2013-10-31 16:15:27,426 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-750470584501963121_1282 size 26355
2013-10-31 16:15:27,427 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48803, dest: /127.0.0.1:47311, bytes: 26355, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-750470584501963121_1282, duration: 1246329
2013-10-31 16:15:27,428 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-750470584501963121_1282 terminating
2013-10-31 16:15:27,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35769, dest: /127.0.0.1:38271, bytes: 26355, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-750470584501963121_1282, duration: 2561948
2013-10-31 16:15:27,429 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-750470584501963121_1282 terminating
2013-10-31 16:15:27,433 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-750470584501963121_1282 size 26355
2013-10-31 16:15:27,434 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D from client DFSClient_708454635
2013-10-31 16:15:27,434 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D is closed by DFSClient_708454635
2013-10-31 16:15:27,435 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-750470584501963121_1282 size 26355
2013-10-31 16:15:27,437 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9086653742670772437_1272 file build/test/data/dfs/data/data4/current/blk_-9086653742670772437 for deletion
2013-10-31 16:15:27,437 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1379367158697454854_1273 file build/test/data/dfs/data/data3/current/blk_-1379367158697454854 for deletion
2013-10-31 16:15:27,437 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9086653742670772437_1272 at file build/test/data/dfs/data/data4/current/blk_-9086653742670772437
2013-10-31 16:15:27,437 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2440796546292724629_1271 file build/test/data/dfs/data/data3/current/blk_2440796546292724629 for deletion
2013-10-31 16:15:27,437 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1379367158697454854_1273 at file build/test/data/dfs/data/data3/current/blk_-1379367158697454854
2013-10-31 16:15:27,438 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8544072883402237301_1270 file build/test/data/dfs/data/data4/current/blk_8544072883402237301 for deletion
2013-10-31 16:15:27,438 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2440796546292724629_1271 at file build/test/data/dfs/data/data3/current/blk_2440796546292724629
2013-10-31 16:15:27,438 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8544072883402237301_1270 at file build/test/data/dfs/data/data4/current/blk_8544072883402237301
2013-10-31 16:15:27,443 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:27,444 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000004_0'
2013-10-31 16:15:27,444 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000005_0'
2013-10-31 16:15:27,446 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1994160069267862725 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:27,446 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1994160069267862725 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:27,446 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1994160069267862725 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:27,448 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper2*lower*upper1] starting step: (1/2) ...orm/joinaroundjoinswapped
2013-10-31 16:15:27,449 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0024_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:27,449 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0024
2013-10-31 16:15:27,450 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0024 being deleted.
2013-10-31 16:15:27,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024	dst=null	perm=null
2013-10-31 16:15:27,454 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:15:27,455 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:15:27,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:27,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:15:27,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,478 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar. blk_-3002501081053343053_1283
2013-10-31 16:15:27,479 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002501081053343053_1283 src: /127.0.0.1:55809 dest: /127.0.0.1:41648
2013-10-31 16:15:27,481 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002501081053343053_1283 src: /127.0.0.1:48807 dest: /127.0.0.1:47311
2013-10-31 16:15:27,482 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002501081053343053_1283 src: /127.0.0.1:35775 dest: /127.0.0.1:38271
2013-10-31 16:15:27,490 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35775, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3002501081053343053_1283, duration: 3754857
2013-10-31 16:15:27,490 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3002501081053343053_1283 terminating
2013-10-31 16:15:27,490 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48807, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3002501081053343053_1283, duration: 4516186
2013-10-31 16:15:27,491 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3002501081053343053_1283 size 238055
2013-10-31 16:15:27,491 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3002501081053343053_1283 terminating
2013-10-31 16:15:27,491 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55809, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3002501081053343053_1283, duration: 5589826
2013-10-31 16:15:27,492 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3002501081053343053_1283 terminating
2013-10-31 16:15:27,493 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3002501081053343053_1283 size 238055
2013-10-31 16:15:27,494 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar from client DFSClient_1457307213
2013-10-31 16:15:27,494 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar is closed by DFSClient_1457307213
2013-10-31 16:15:27,495 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3002501081053343053_1283 size 238055
2013-10-31 16:15:27,500 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar. New replication is 10
2013-10-31 16:15:27,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar	dst=null	perm=null
2013-10-31 16:15:27,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,512 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:15:27,516 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:15:27,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:27,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,533 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split. New replication is 10
2013-10-31 16:15:27,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split	dst=null	perm=null
2013-10-31 16:15:27,540 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split. blk_-7897376192076226208_1284
2013-10-31 16:15:27,541 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7897376192076226208_1284 src: /127.0.0.1:55812 dest: /127.0.0.1:41648
2013-10-31 16:15:27,543 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7897376192076226208_1284 src: /127.0.0.1:48810 dest: /127.0.0.1:47311
2013-10-31 16:15:27,545 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7897376192076226208_1284 src: /127.0.0.1:35778 dest: /127.0.0.1:38271
2013-10-31 16:15:27,546 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7897376192076226208_1284 src: /127.0.0.1:35710 dest: /127.0.0.1:50942
2013-10-31 16:15:27,549 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35710, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7897376192076226208_1284, duration: 112541
2013-10-31 16:15:27,550 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7897376192076226208_1284 terminating
2013-10-31 16:15:27,550 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7897376192076226208_1284 size 1732
2013-10-31 16:15:27,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35778, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7897376192076226208_1284, duration: 946481
2013-10-31 16:15:27,551 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7897376192076226208_1284 terminating
2013-10-31 16:15:27,551 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48810, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7897376192076226208_1284, duration: 2009292
2013-10-31 16:15:27,552 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7897376192076226208_1284 terminating
2013-10-31 16:15:27,552 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55812, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7897376192076226208_1284, duration: 2867257
2013-10-31 16:15:27,553 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7897376192076226208_1284 terminating
2013-10-31 16:15:27,554 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7897376192076226208_1284 size 1732
2013-10-31 16:15:27,554 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split from client DFSClient_1457307213
2013-10-31 16:15:27,555 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split is closed by DFSClient_1457307213
2013-10-31 16:15:27,555 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7897376192076226208_1284 size 1732
2013-10-31 16:15:27,557 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7897376192076226208_1284 size 1732
2013-10-31 16:15:27,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,576 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo. blk_-3800742364459467549_1285
2013-10-31 16:15:27,577 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3800742364459467549_1285 src: /127.0.0.1:48813 dest: /127.0.0.1:47311
2013-10-31 16:15:27,579 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3800742364459467549_1285 src: /127.0.0.1:35781 dest: /127.0.0.1:38271
2013-10-31 16:15:27,581 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3800742364459467549_1285 src: /127.0.0.1:55818 dest: /127.0.0.1:41648
2013-10-31 16:15:27,584 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55818, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3800742364459467549_1285, duration: 62272
2013-10-31 16:15:27,584 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3800742364459467549_1285 terminating
2013-10-31 16:15:27,584 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35781, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3800742364459467549_1285, duration: 833676
2013-10-31 16:15:27,585 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3800742364459467549_1285 terminating
2013-10-31 16:15:27,585 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48813, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3800742364459467549_1285, duration: 1652085
2013-10-31 16:15:27,586 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3800742364459467549_1285 size 183
2013-10-31 16:15:27,586 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3800742364459467549_1285 terminating
2013-10-31 16:15:27,588 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3800742364459467549_1285 size 183
2013-10-31 16:15:27,588 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:15:27,589 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:15:27,589 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3800742364459467549_1285 size 183
2013-10-31 16:15:27,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,621 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml. blk_3515738870572374906_1286
2013-10-31 16:15:27,623 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3515738870572374906_1286 src: /127.0.0.1:35714 dest: /127.0.0.1:50942
2013-10-31 16:15:27,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3515738870572374906_1286 src: /127.0.0.1:48817 dest: /127.0.0.1:47311
2013-10-31 16:15:27,626 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3515738870572374906_1286 src: /127.0.0.1:35785 dest: /127.0.0.1:38271
2013-10-31 16:15:27,629 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35785, dest: /127.0.0.1:38271, bytes: 28718, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3515738870572374906_1286, duration: 85810
2013-10-31 16:15:27,629 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3515738870572374906_1286 terminating
2013-10-31 16:15:27,629 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3515738870572374906_1286 size 28718
2013-10-31 16:15:27,629 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48817, dest: /127.0.0.1:47311, bytes: 28718, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3515738870572374906_1286, duration: 865359
2013-10-31 16:15:27,630 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3515738870572374906_1286 size 28718
2013-10-31 16:15:27,630 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3515738870572374906_1286 terminating
2013-10-31 16:15:27,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35714, dest: /127.0.0.1:50942, bytes: 28718, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3515738870572374906_1286, duration: 1893934
2013-10-31 16:15:27,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3515738870572374906_1286 terminating
2013-10-31 16:15:27,634 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3515738870572374906_1286 size 28718
2013-10-31 16:15:27,634 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml from client DFSClient_1457307213
2013-10-31 16:15:27,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml is closed by DFSClient_1457307213
2013-10-31 16:15:27,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml	dst=null	perm=null
2013-10-31 16:15:27,649 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35718, bytes: 28946, op: HDFS_READ, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3515738870572374906_1286, duration: 377502
2013-10-31 16:15:27,668 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0025: nMaps=5 nReduces=0 max=-1
2013-10-31 16:15:27,669 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0025 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:15:27,669 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0025
2013-10-31 16:15:27,669 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0025	RESULT=SUCCESS
2013-10-31 16:15:27,669 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0025
2013-10-31 16:15:27,671 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper2*lower*upper1] submitted hadoop job: job_20131031160444934_0025
2013-10-31 16:15:28,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:28,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:28,337 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_conf.xml. blk_-2854511013015993238_1288
2013-10-31 16:15:28,339 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2854511013015993238_1288 src: /127.0.0.1:48821 dest: /127.0.0.1:47311
2013-10-31 16:15:28,341 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2854511013015993238_1288 src: /127.0.0.1:55825 dest: /127.0.0.1:41648
2013-10-31 16:15:28,343 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2854511013015993238_1288 src: /127.0.0.1:35721 dest: /127.0.0.1:50942
2013-10-31 16:15:28,347 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35721, dest: /127.0.0.1:50942, bytes: 28783, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2854511013015993238_1288, duration: 770468
2013-10-31 16:15:28,347 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2854511013015993238_1288 terminating
2013-10-31 16:15:28,348 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55825, dest: /127.0.0.1:41648, bytes: 28783, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2854511013015993238_1288, duration: 1608239
2013-10-31 16:15:28,348 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2854511013015993238_1288 terminating
2013-10-31 16:15:28,348 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48821, dest: /127.0.0.1:47311, bytes: 28783, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2854511013015993238_1288, duration: 2836448
2013-10-31 16:15:28,349 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2854511013015993238_1288 size 28783
2013-10-31 16:15:28,349 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2854511013015993238_1288 terminating
2013-10-31 16:15:28,351 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2854511013015993238_1288 size 28783
2013-10-31 16:15:28,351 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_conf.xml from client DFSClient_-460164648
2013-10-31 16:15:28,352 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_conf.xml is closed by DFSClient_-460164648
2013-10-31 16:15:28,352 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2854511013015993238_1288 size 28783
2013-10-31 16:15:28,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:28,366 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken. blk_-661464544657018414_1289
2013-10-31 16:15:28,367 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-661464544657018414_1289 src: /127.0.0.1:35722 dest: /127.0.0.1:50942
2013-10-31 16:15:28,369 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-661464544657018414_1289 src: /127.0.0.1:35792 dest: /127.0.0.1:38271
2013-10-31 16:15:28,370 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-661464544657018414_1289 src: /127.0.0.1:48826 dest: /127.0.0.1:47311
2013-10-31 16:15:28,374 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48826, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-661464544657018414_1289, duration: 87571
2013-10-31 16:15:28,374 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-661464544657018414_1289 terminating
2013-10-31 16:15:28,374 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-661464544657018414_1289 size 116
2013-10-31 16:15:28,375 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35792, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-661464544657018414_1289, duration: 918157
2013-10-31 16:15:28,375 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-661464544657018414_1289 terminating
2013-10-31 16:15:28,376 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35722, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-661464544657018414_1289, duration: 2099909
2013-10-31 16:15:28,376 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-661464544657018414_1289 size 116
2013-10-31 16:15:28,376 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-661464544657018414_1289 terminating
2013-10-31 16:15:28,381 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-661464544657018414_1289 size 116
2013-10-31 16:15:28,382 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken from client DFSClient_1457307213
2013-10-31 16:15:28,382 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken is closed by DFSClient_1457307213
2013-10-31 16:15:28,389 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken
2013-10-31 16:15:28,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:15:28,393 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55830, bytes: 187, op: HDFS_READ, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3800742364459467549_1285, duration: 270477
2013-10-31 16:15:28,394 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0025 = 19. Number of splits = 5
2013-10-31 16:15:28,395 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,395 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,395 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,395 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,396 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,396 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,396 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,396 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,397 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,397 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,397 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,397 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,398 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,398 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,398 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,398 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0025 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:15:28,399 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0025 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:15:29,993 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0025_m_000006_0' to tip task_20131031160444934_0025_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:29,998 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000000_0'
2013-10-31 16:15:29,998 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000001_0'
2013-10-31 16:15:29,998 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000006_0'
2013-10-31 16:15:30,000 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:15:30,000 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000006_0 which needs 1 slots
2013-10-31 16:15:30,000 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000006_0 which needs 1 slots
2013-10-31 16:15:30,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken	dst=null	perm=null
2013-10-31 16:15:30,009 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35795, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-661464544657018414_1289, duration: 281317
2013-10-31 16:15:30,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml	dst=null	perm=null
2013-10-31 16:15:30,019 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48830, bytes: 28946, op: HDFS_READ, cliID: DFSClient_-733898883, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3515738870572374906_1286, duration: 399003
2013-10-31 16:15:30,041 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2440796546292724629_1271 file build/test/data/dfs/data/data7/current/blk_2440796546292724629 for deletion
2013-10-31 16:15:30,041 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2440796546292724629_1271 at file build/test/data/dfs/data/data7/current/blk_2440796546292724629
2013-10-31 16:15:30,041 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8544072883402237301_1270 file build/test/data/dfs/data/data8/current/blk_8544072883402237301 for deletion
2013-10-31 16:15:30,041 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8544072883402237301_1270 at file build/test/data/dfs/data/data8/current/blk_8544072883402237301
2013-10-31 16:15:30,050 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:30,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar	dst=null	perm=null
2013-10-31 16:15:30,070 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48831, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-733898883, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3002501081053343053_1283, duration: 619648
2013-10-31 16:15:30,145 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0024_m_624470708
2013-10-31 16:15:30,152 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24986 with signal TERM. Exit code 0
2013-10-31 16:15:30,153 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_-2015129647
2013-10-31 16:15:30,153 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_-2015129647 spawned.
2013-10-31 16:15:30,160 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000006_0/taskjvm.sh
2013-10-31 16:15:30,193 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000002_0'
2013-10-31 16:15:30,194 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000003_0'
2013-10-31 16:15:30,225 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:30,225 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:30,226 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:30,226 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_624470708 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:30,292 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-3002501081053343053_1283 to datanode(s) 127.0.0.1:50942
2013-10-31 16:15:30,292 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_1994160069267862725_1276
2013-10-31 16:15:30,293 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_1994160069267862725_1276
2013-10-31 16:15:31,520 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_-2015129647 given task: attempt_20131031160444934_0025_m_000006_0
2013-10-31 16:15:32,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:32,446 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0024
2013-10-31 16:15:32,446 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000005_0 not found in cache
2013-10-31 16:15:32,447 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000004_0 not found in cache
2013-10-31 16:15:32,447 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0024 for user-log deletion with retainTimeStamp:1383322532447
2013-10-31 16:15:32,522 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_-2077162363 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:32,533 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25104 with signal TERM. Exit code 0
2013-10-31 16:15:32,721 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:32,721 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:32,721 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:32,722 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_-2077162363 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:32,839 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-3002501081053343053_1283 to 127.0.0.1:50942 
2013-10-31 16:15:32,839 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1994160069267862725_1276 file build/test/data/dfs/data/data1/current/blk_1994160069267862725 for deletion
2013-10-31 16:15:32,840 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1994160069267862725_1276 at file build/test/data/dfs/data/data1/current/blk_1994160069267862725
2013-10-31 16:15:32,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002501081053343053_1283 src: /127.0.0.1:35733 dest: /127.0.0.1:50942
2013-10-31 16:15:32,841 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-3002501081053343053_1283 to /127.0.0.1:50942
2013-10-31 16:15:32,844 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3002501081053343053_1283 src: /127.0.0.1:35733 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:15:32,846 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3002501081053343053_1283 size 238055
2013-10-31 16:15:32,847 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 16:15:32,851 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 4ms
2013-10-31 16:15:33,040 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:15:33,047 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:50942, blocks: 81, processing time: 6 msecs
2013-10-31 16:15:33,048 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 81 blocks took 0 msec to generate and 8 msecs for RPC and NN processing
2013-10-31 16:15:33,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1994160069267862725_1276 file build/test/data/dfs/data/data7/current/blk_1994160069267862725 for deletion
2013-10-31 16:15:33,050 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1994160069267862725_1276 at file build/test/data/dfs/data/data7/current/blk_1994160069267862725
2013-10-31 16:15:33,293 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_1994160069267862725_1276
2013-10-31 16:15:33,861 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_543313488 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:33,872 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25329 with signal TERM. Exit code 0
2013-10-31 16:15:34,045 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:34,045 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:34,045 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:34,046 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_543313488 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:34,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1994160069267862725_1276 file build/test/data/dfs/data/data5/current/blk_1994160069267862725 for deletion
2013-10-31 16:15:34,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1994160069267862725_1276 at file build/test/data/dfs/data/data5/current/blk_1994160069267862725
2013-10-31 16:15:34,959 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000006_0 0.0% setup
2013-10-31 16:15:34,962 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000006_0 is done.
2013-10-31 16:15:34,962 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000006_0  was -1
2013-10-31 16:15:34,962 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:35,000 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0024
2013-10-31 16:15:35,000 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000001_0 not found in cache
2013-10-31 16:15:35,000 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000000_0 not found in cache
2013-10-31 16:15:35,001 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0024 for user-log deletion with retainTimeStamp:1383322535001
2013-10-31 16:15:35,194 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0024
2013-10-31 16:15:35,195 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000002_0 not found in cache
2013-10-31 16:15:35,195 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000003_0 not found in cache
2013-10-31 16:15:35,195 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0024 for user-log deletion with retainTimeStamp:1383322535195
2013-10-31 16:15:35,350 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_-2014524527 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:35,359 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25066 with signal TERM. Exit code 0
2013-10-31 16:15:35,470 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_-14244859 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:35,481 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24852 with signal TERM. Exit code 0
2013-10-31 16:15:35,527 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_-318845689 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:35,535 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25105 with signal TERM. Exit code 0
2013-10-31 16:15:35,542 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:35,542 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:35,542 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:35,542 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_-2014524527 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:35,677 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:35,677 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:35,677 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:35,678 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_-14244859 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:15:35,710 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:35,711 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:35,711 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:35,711 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_-318845689 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:36,006 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000006_0' has completed task_20131031160444934_0025_m_000006 successfully.
2013-10-31 16:15:36,009 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000000_0' to tip task_20131031160444934_0025_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:36,010 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000000
2013-10-31 16:15:36,011 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000001_0' to tip task_20131031160444934_0025_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:36,011 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000001
2013-10-31 16:15:36,013 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:15:36,014 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:15:36,015 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000000_0 which needs 1 slots
2013-10-31 16:15:36,015 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000000_0 which needs 1 slots
2013-10-31 16:15:36,016 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000001_0 which needs 1 slots
2013-10-31 16:15:36,016 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0025_m_000001_0 which needs 1 slots
2013-10-31 16:15:36,048 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_-741228692
2013-10-31 16:15:36,048 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_-741228692 spawned.
2013-10-31 16:15:36,049 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0025/attempt_20131031160444934_0025_m_000001_0. Attempting to reuse: jvm_20131031160444934_0025_m_-2015129647
2013-10-31 16:15:36,050 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000000_0/taskjvm.sh
2013-10-31 16:15:36,201 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000002_0' to tip task_20131031160444934_0025_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:36,202 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000002
2013-10-31 16:15:36,202 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000003_0' to tip task_20131031160444934_0025_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:36,242 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000003
2013-10-31 16:15:36,244 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:15:36,245 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:15:36,245 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000002_0 which needs 1 slots
2013-10-31 16:15:36,246 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000002_0 which needs 1 slots
2013-10-31 16:15:36,246 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000003_0 which needs 1 slots
2013-10-31 16:15:36,246 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0025_m_000003_0 which needs 1 slots
2013-10-31 16:15:36,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken	dst=null	perm=null
2013-10-31 16:15:36,275 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35737, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-661464544657018414_1289, duration: 285905
2013-10-31 16:15:36,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml	dst=null	perm=null
2013-10-31 16:15:36,287 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35808, bytes: 28946, op: HDFS_READ, cliID: DFSClient_-1875078242, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3515738870572374906_1286, duration: 413202
2013-10-31 16:15:36,308 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:36,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar	dst=null	perm=null
2013-10-31 16:15:36,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55845, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1875078242, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3002501081053343053_1283, duration: 594809
2013-10-31 16:15:36,373 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_331774167
2013-10-31 16:15:36,374 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_331774167 spawned.
2013-10-31 16:15:36,374 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_38283024
2013-10-31 16:15:36,375 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_38283024 spawned.
2013-10-31 16:15:36,376 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000002_0/taskjvm.sh
2013-10-31 16:15:36,376 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000003_0/taskjvm.sh
2013-10-31 16:15:36,459 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000004_0' to tip task_20131031160444934_0025_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:15:36,459 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000004
2013-10-31 16:15:36,461 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:15:36,461 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000004_0 which needs 1 slots
2013-10-31 16:15:36,462 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000004_0 which needs 1 slots
2013-10-31 16:15:36,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken	dst=null	perm=null
2013-10-31 16:15:36,467 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35741, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-661464544657018414_1289, duration: 367034
2013-10-31 16:15:36,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml	dst=null	perm=null
2013-10-31 16:15:36,472 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35743, bytes: 28946, op: HDFS_READ, cliID: DFSClient_2074604822, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3515738870572374906_1286, duration: 386115
2013-10-31 16:15:36,490 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:36,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar	dst=null	perm=null
2013-10-31 16:15:36,510 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48846, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2074604822, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3002501081053343053_1283, duration: 570588
2013-10-31 16:15:36,517 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_-2015129647 given task: attempt_20131031160444934_0025_m_000001_0
2013-10-31 16:15:36,563 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_-922718880
2013-10-31 16:15:36,564 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_-922718880 spawned.
2013-10-31 16:15:36,565 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000004_0/taskjvm.sh
2013-10-31 16:15:36,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split	dst=null	perm=null
2013-10-31 16:15:36,783 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48848, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7897376192076226208_1284, duration: 170494
2013-10-31 16:15:36,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:36,824 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35747, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 134741
2013-10-31 16:15:36,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:36,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:37,062 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_-741228692 given task: attempt_20131031160444934_0025_m_000000_0
2013-10-31 16:15:37,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=null
2013-10-31 16:15:37,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:37,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:37,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:37,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:37,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:37,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:37,116 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55854, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2623433961007257862_1277, duration: 129401
2013-10-31 16:15:37,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:37,133 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55855, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2558601193971908172_1278, duration: 105650
2013-10-31 16:15:37,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:37,136 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55856, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7985283914289950420_1279, duration: 99143
2013-10-31 16:15:37,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:37,139 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35821, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1719649238952092533_1281, duration: 98860
2013-10-31 16:15:37,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:37,142 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35822, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8601652280056973022_1281, duration: 139118
2013-10-31 16:15:37,151 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001. blk_-6384772226567960736_1290
2013-10-31 16:15:37,167 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6384772226567960736_1290 src: /127.0.0.1:48856 dest: /127.0.0.1:47311
2013-10-31 16:15:37,168 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6384772226567960736_1290 src: /127.0.0.1:35824 dest: /127.0.0.1:38271
2013-10-31 16:15:37,169 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6384772226567960736_1290 src: /127.0.0.1:35756 dest: /127.0.0.1:50942
2013-10-31 16:15:37,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35756, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6384772226567960736_1290, duration: 1712921
2013-10-31 16:15:37,172 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6384772226567960736_1290 terminating
2013-10-31 16:15:37,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35824, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6384772226567960736_1290, duration: 2193821
2013-10-31 16:15:37,172 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6384772226567960736_1290 terminating
2013-10-31 16:15:37,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48856, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6384772226567960736_1290, duration: 2594604
2013-10-31 16:15:37,173 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6384772226567960736_1290 terminating
2013-10-31 16:15:37,173 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6384772226567960736_1290 size 12
2013-10-31 16:15:37,175 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6384772226567960736_1290 size 12
2013-10-31 16:15:37,175 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0025_m_000001_0
2013-10-31 16:15:37,175 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0025_m_000001_0
2013-10-31 16:15:37,175 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6384772226567960736_1290 size 12
2013-10-31 16:15:37,216 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:37,216 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000001_0 0.0% 
2013-10-31 16:15:37,363 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_331774167 given task: attempt_20131031160444934_0025_m_000002_0
2013-10-31 16:15:37,514 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_38283024 given task: attempt_20131031160444934_0025_m_000003_0
2013-10-31 16:15:37,544 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_-922718880 given task: attempt_20131031160444934_0025_m_000004_0
2013-10-31 16:15:37,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split	dst=null	perm=null
2013-10-31 16:15:37,569 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48863, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7897376192076226208_1284, duration: 173000
2013-10-31 16:15:37,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:37,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:37,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:37,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=null
2013-10-31 16:15:37,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:37,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:37,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:37,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:37,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:37,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:37,852 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35832, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2623433961007257862_1277, duration: 147639
2013-10-31 16:15:37,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split	dst=null	perm=null
2013-10-31 16:15:37,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:37,869 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35833, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2558601193971908172_1278, duration: 104875
2013-10-31 16:15:37,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:37,872 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35834, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7985283914289950420_1279, duration: 105233
2013-10-31 16:15:37,874 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35766, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7897376192076226208_1284, duration: 148281
2013-10-31 16:15:37,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:37,875 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35767, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1719649238952092533_1281, duration: 99610
2013-10-31 16:15:37,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:37,878 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35837, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8601652280056973022_1281, duration: 100435
2013-10-31 16:15:37,881 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55874, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 108871
2013-10-31 16:15:37,888 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000. blk_1107000733830591378_1291
2013-10-31 16:15:37,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107000733830591378_1291 src: /127.0.0.1:55875 dest: /127.0.0.1:41648
2013-10-31 16:15:37,911 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107000733830591378_1291 src: /127.0.0.1:35840 dest: /127.0.0.1:38271
2013-10-31 16:15:37,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:37,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107000733830591378_1291 src: /127.0.0.1:35772 dest: /127.0.0.1:50942
2013-10-31 16:15:37,913 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35773, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 113741
2013-10-31 16:15:37,914 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35772, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1107000733830591378_1291, duration: 1298013
2013-10-31 16:15:37,914 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1107000733830591378_1291 terminating
2013-10-31 16:15:37,914 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35840, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1107000733830591378_1291, duration: 1407364
2013-10-31 16:15:37,914 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1107000733830591378_1291 terminating
2013-10-31 16:15:37,914 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55875, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1107000733830591378_1291, duration: 1817485
2013-10-31 16:15:37,915 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1107000733830591378_1291 terminating
2013-10-31 16:15:37,915 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1107000733830591378_1291 size 12
2013-10-31 16:15:37,916 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0025_m_000000_0
2013-10-31 16:15:37,916 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0025_m_000000_0
2013-10-31 16:15:37,916 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1107000733830591378_1291 size 12
2013-10-31 16:15:37,916 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1107000733830591378_1291 size 12
2013-10-31 16:15:37,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:37,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:37,965 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:37,965 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000000_0 0.0% 
2013-10-31 16:15:38,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split	dst=null	perm=null
2013-10-31 16:15:38,023 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35776, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7897376192076226208_1284, duration: 172026
2013-10-31 16:15:38,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split	dst=null	perm=null
2013-10-31 16:15:38,045 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35777, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7897376192076226208_1284, duration: 167826
2013-10-31 16:15:38,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:38,062 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35778, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 99938
2013-10-31 16:15:38,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:38,085 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35779, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 212004
2013-10-31 16:15:38,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=null
2013-10-31 16:15:38,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:38,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:38,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:38,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:38,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:38,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:38,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:38,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:38,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:38,335 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35780, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2623433961007257862_1277, duration: 278199
2013-10-31 16:15:38,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:38,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:38,354 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55886, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2558601193971908172_1278, duration: 258702
2013-10-31 16:15:38,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:38,358 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35782, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7985283914289950420_1279, duration: 251675
2013-10-31 16:15:38,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:38,362 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55888, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1719649238952092533_1281, duration: 251251
2013-10-31 16:15:38,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:38,367 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55889, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8601652280056973022_1281, duration: 278016
2013-10-31 16:15:38,376 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002. blk_9211691514110189620_1294
2013-10-31 16:15:38,399 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9211691514110189620_1294 src: /127.0.0.1:35854 dest: /127.0.0.1:38271
2013-10-31 16:15:38,400 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9211691514110189620_1294 src: /127.0.0.1:48888 dest: /127.0.0.1:47311
2013-10-31 16:15:38,401 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9211691514110189620_1294 src: /127.0.0.1:55892 dest: /127.0.0.1:41648
2013-10-31 16:15:38,405 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55892, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_9211691514110189620_1294, duration: 1585353
2013-10-31 16:15:38,405 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9211691514110189620_1294 terminating
2013-10-31 16:15:38,405 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48888, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_9211691514110189620_1294, duration: 2740011
2013-10-31 16:15:38,405 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9211691514110189620_1294 terminating
2013-10-31 16:15:38,406 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35854, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9211691514110189620_1294, duration: 3163112
2013-10-31 16:15:38,406 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9211691514110189620_1294 terminating
2013-10-31 16:15:38,406 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_9211691514110189620_1294 size 12
2013-10-31 16:15:38,407 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0025_m_000002_0
2013-10-31 16:15:38,407 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0025_m_000002_0
2013-10-31 16:15:38,409 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_9211691514110189620_1294 size 12
2013-10-31 16:15:38,409 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_9211691514110189620_1294 size 12
2013-10-31 16:15:38,453 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:38,454 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000002_0 0.0% 
2013-10-31 16:15:38,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=null
2013-10-31 16:15:38,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:38,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=null
2013-10-31 16:15:38,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:38,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:38,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:38,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:38,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:38,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:38,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:38,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:38,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:38,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:38,563 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35857, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2623433961007257862_1277, duration: 122476
2013-10-31 16:15:38,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000	dst=null	perm=null
2013-10-31 16:15:38,568 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35858, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2623433961007257862_1277, duration: 134804
2013-10-31 16:15:38,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:38,580 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55895, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2558601193971908172_1278, duration: 103235
2013-10-31 16:15:38,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:38,583 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35860, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7985283914289950420_1279, duration: 99742
2013-10-31 16:15:38,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001	dst=null	perm=null
2013-10-31 16:15:38,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:38,585 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48894, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2558601193971908172_1278, duration: 108694
2013-10-31 16:15:38,586 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35862, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1719649238952092533_1281, duration: 106205
2013-10-31 16:15:38,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002	dst=null	perm=null
2013-10-31 16:15:38,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:38,588 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35794, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7985283914289950420_1279, duration: 98490
2013-10-31 16:15:38,588 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55900, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8601652280056973022_1281, duration: 100773
2013-10-31 16:15:38,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003	dst=null	perm=null
2013-10-31 16:15:38,590 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35865, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1719649238952092533_1281, duration: 120892
2013-10-31 16:15:38,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004	dst=null	perm=null
2013-10-31 16:15:38,593 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35866, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8601652280056973022_1281, duration: 98125
2013-10-31 16:15:38,597 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004. blk_-8824242536225630163_1294
2013-10-31 16:15:38,603 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003. blk_-4243449972058944542_1294
2013-10-31 16:15:38,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8824242536225630163_1294 src: /127.0.0.1:35867 dest: /127.0.0.1:38271
2013-10-31 16:15:38,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8824242536225630163_1294 src: /127.0.0.1:35800 dest: /127.0.0.1:50942
2013-10-31 16:15:38,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8824242536225630163_1294 src: /127.0.0.1:48903 dest: /127.0.0.1:47311
2013-10-31 16:15:38,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48903, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8824242536225630163_1294, duration: 1240950
2013-10-31 16:15:38,623 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8824242536225630163_1294 terminating
2013-10-31 16:15:38,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35800, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8824242536225630163_1294, duration: 1347284
2013-10-31 16:15:38,624 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8824242536225630163_1294 terminating
2013-10-31 16:15:38,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35867, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8824242536225630163_1294, duration: 1724363
2013-10-31 16:15:38,624 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8824242536225630163_1294 terminating
2013-10-31 16:15:38,624 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8824242536225630163_1294 size 12
2013-10-31 16:15:38,625 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0025_m_000004_0
2013-10-31 16:15:38,625 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0025_m_000004_0
2013-10-31 16:15:38,626 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8824242536225630163_1294 size 12
2013-10-31 16:15:38,627 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8824242536225630163_1294 size 12
2013-10-31 16:15:38,635 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4243449972058944542_1294 src: /127.0.0.1:55904 dest: /127.0.0.1:41648
2013-10-31 16:15:38,636 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4243449972058944542_1294 src: /127.0.0.1:48904 dest: /127.0.0.1:47311
2013-10-31 16:15:38,637 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4243449972058944542_1294 src: /127.0.0.1:35803 dest: /127.0.0.1:50942
2013-10-31 16:15:38,638 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35803, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4243449972058944542_1294, duration: 957122
2013-10-31 16:15:38,639 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4243449972058944542_1294 terminating
2013-10-31 16:15:38,639 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48904, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4243449972058944542_1294, duration: 1324621
2013-10-31 16:15:38,639 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4243449972058944542_1294 terminating
2013-10-31 16:15:38,639 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55904, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4243449972058944542_1294, duration: 1787337
2013-10-31 16:15:38,640 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4243449972058944542_1294 terminating
2013-10-31 16:15:38,642 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4243449972058944542_1294 size 12
2013-10-31 16:15:38,642 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4243449972058944542_1294 size 12
2013-10-31 16:15:38,643 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4243449972058944542_1294 size 12
2013-10-31 16:15:38,670 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:38,670 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000004_0 0.0% 
2013-10-31 16:15:39,018 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000000_0
2013-10-31 16:15:39,018 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000001_0
2013-10-31 16:15:39,041 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0025_m_000003_0
2013-10-31 16:15:39,042 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0025_m_000003_0
2013-10-31 16:15:39,108 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:39,108 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000003_0 0.0% 
2013-10-31 16:15:39,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0	dst=null	perm=null
2013-10-31 16:15:39,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:39,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:39,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0	dst=null	perm=null
2013-10-31 16:15:39,252 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000002_0
2013-10-31 16:15:39,252 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000003_0
2013-10-31 16:15:39,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0	dst=null	perm=null
2013-10-31 16:15:39,465 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000004_0
2013-10-31 16:15:39,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:39,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:39,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0	dst=null	perm=null
2013-10-31 16:15:39,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0	dst=null	perm=null
2013-10-31 16:15:39,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:39,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:39,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0	dst=null	perm=null
2013-10-31 16:15:39,747 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:15:39,748 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000001_0 is done.
2013-10-31 16:15:39,748 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000001_0  was -1
2013-10-31 16:15:39,749 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:15:39,847 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:15:39,861 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,867 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,872 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,878 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,883 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,888 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,888 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:15:39,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0	dst=null	perm=null
2013-10-31 16:15:39,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:39,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:40,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0	dst=null	perm=null
2013-10-31 16:15:40,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:40,801 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:15:40,803 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000002_0 is done.
2013-10-31 16:15:40,803 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000002_0  was -1
2013-10-31 16:15:40,803 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:15:40,972 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:15:40,975 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000004_0 is done.
2013-10-31 16:15:40,975 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000004_0  was -1
2013-10-31 16:15:40,975 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:41,015 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0025_m_000006_0
2013-10-31 16:15:41,015 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0025_m_000006_0
2013-10-31 16:15:41,015 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000006_0 not found in cache
2013-10-31 16:15:41,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0	dst=null	perm=null
2013-10-31 16:15:41,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:41,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0	dst=null	perm=null
2013-10-31 16:15:42,021 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000001_0' has completed task_20131031160444934_0025_m_000001 successfully.
2013-10-31 16:15:42,256 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000002_0' has completed task_20131031160444934_0025_m_000002 successfully.
2013-10-31 16:15:42,468 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000004_0' has completed task_20131031160444934_0025_m_000004 successfully.
2013-10-31 16:15:43,567 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:15:43,574 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:15:43,575 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000000_0 is done.
2013-10-31 16:15:43,575 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000000_0  was -1
2013-10-31 16:15:43,575 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:44,003 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:15:44,007 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:15:44,007 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000003_0 is done.
2013-10-31 16:15:44,007 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000003_0  was -1
2013-10-31 16:15:44,008 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:45,027 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000000_0' has completed task_20131031160444934_0025_m_000000 successfully.
2013-10-31 16:15:45,260 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000003_0' has completed task_20131031160444934_0025_m_000003 successfully.
2013-10-31 16:15:45,263 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0025_m_000005_0' to tip task_20131031160444934_0025_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:45,265 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:15:45,266 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000005_0 which needs 1 slots
2013-10-31 16:15:45,266 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000005_0 which needs 1 slots
2013-10-31 16:15:45,303 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0025/attempt_20131031160444934_0025_m_000005_0. Attempting to reuse: jvm_20131031160444934_0025_m_331774167
2013-10-31 16:15:45,859 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_331774167 given task: attempt_20131031160444934_0025_m_000005_0
2013-10-31 16:15:45,979 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000005_0 0.0% 
2013-10-31 16:15:45,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary	dst=null	perm=null
2013-10-31 16:15:45,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:45,992 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS from client DFSClient_attempt_20131031160444934_0025_m_000005_0
2013-10-31 16:15:45,992 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0025_m_000005_0
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002501081053343053 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002501081053343053 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002501081053343053 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002501081053343053 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7897376192076226208 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7897376192076226208 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7897376192076226208 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7897376192076226208 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3800742364459467549 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3800742364459467549 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3800742364459467549 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:45,997 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3515738870572374906 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:45,998 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3515738870572374906 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:45,998 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3515738870572374906 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:46,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025	dst=null	perm=null
2013-10-31 16:15:48,296 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-3002501081053343053_1283 blk_-7897376192076226208_1284 blk_-3800742364459467549_1285
2013-10-31 16:15:48,296 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_3515738870572374906_1286 blk_-3002501081053343053_1283 blk_-7897376192076226208_1284
2013-10-31 16:15:48,953 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000005_0 0.0% cleanup
2013-10-31 16:15:48,954 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000005_0 is done.
2013-10-31 16:15:48,955 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000005_0  was -1
2013-10-31 16:15:48,955 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:49,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7897376192076226208_1284 file build/test/data/dfs/data/data6/current/blk_-7897376192076226208 for deletion
2013-10-31 16:15:49,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3800742364459467549_1285 file build/test/data/dfs/data/data5/current/blk_-3800742364459467549 for deletion
2013-10-31 16:15:49,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002501081053343053_1283 file build/test/data/dfs/data/data5/current/blk_-3002501081053343053 for deletion
2013-10-31 16:15:49,324 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7897376192076226208_1284 at file build/test/data/dfs/data/data6/current/blk_-7897376192076226208
2013-10-31 16:15:49,324 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3800742364459467549_1285 at file build/test/data/dfs/data/data5/current/blk_-3800742364459467549
2013-10-31 16:15:49,358 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002501081053343053_1283 at file build/test/data/dfs/data/data5/current/blk_-3002501081053343053
2013-10-31 16:15:51,055 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7897376192076226208_1284 file build/test/data/dfs/data/data8/current/blk_-7897376192076226208 for deletion
2013-10-31 16:15:51,055 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002501081053343053_1283 file build/test/data/dfs/data/data8/current/blk_-3002501081053343053 for deletion
2013-10-31 16:15:51,055 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7897376192076226208_1284 at file build/test/data/dfs/data/data8/current/blk_-7897376192076226208
2013-10-31 16:15:51,055 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3515738870572374906_1286 file build/test/data/dfs/data/data7/current/blk_3515738870572374906 for deletion
2013-10-31 16:15:51,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002501081053343053_1283 at file build/test/data/dfs/data/data8/current/blk_-3002501081053343053
2013-10-31 16:15:51,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3515738870572374906_1286 at file build/test/data/dfs/data/data7/current/blk_3515738870572374906
2013-10-31 16:15:51,273 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000005_0' has completed task_20131031160444934_0025_m_000005 successfully.
2013-10-31 16:15:51,274 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0025 has completed successfully.
2013-10-31 16:15:51,275 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0025,submitTime=1383236127640,launchTime=1383236128398,firstMapTaskLaunchTime=1383236136009,firstJobSetupTaskLaunchTime=1383236129993,firstJobCleanupTaskLaunchTime=1383236145263,finishTime=1383236151274,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=36,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[ED56FF6D03804A6891662367F6814562/892D735750CD47CD9D9AA0A84906AB6F] upper2*lower*upper1/(1/2) ...orm/joinaroundjoinswapped
2013-10-31 16:15:51,280 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD. blk_-8290491646553836876_1295
2013-10-31 16:15:51,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8290491646553836876_1295 src: /127.0.0.1:55911 dest: /127.0.0.1:41648
2013-10-31 16:15:51,284 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8290491646553836876_1295 src: /127.0.0.1:35807 dest: /127.0.0.1:50942
2013-10-31 16:15:51,286 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8290491646553836876_1295 src: /127.0.0.1:35877 dest: /127.0.0.1:38271
2013-10-31 16:15:51,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35877, dest: /127.0.0.1:38271, bytes: 26367, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8290491646553836876_1295, duration: 6026670
2013-10-31 16:15:51,296 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8290491646553836876_1295 terminating
2013-10-31 16:15:51,296 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35807, dest: /127.0.0.1:50942, bytes: 26367, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8290491646553836876_1295, duration: 3941232
2013-10-31 16:15:51,297 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8290491646553836876_1295 terminating
2013-10-31 16:15:51,297 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_3515738870572374906_1286 blk_-3002501081053343053_1283 blk_-7897376192076226208_1284 blk_-3800742364459467549_1285
2013-10-31 16:15:51,297 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55911, dest: /127.0.0.1:41648, bytes: 26367, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8290491646553836876_1295, duration: 6880173
2013-10-31 16:15:51,297 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8290491646553836876_1295 size 26367
2013-10-31 16:15:51,298 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8290491646553836876_1295 terminating
2013-10-31 16:15:51,300 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_3515738870572374906_1286 blk_-3002501081053343053_1283 blk_-7897376192076226208_1284 blk_-3800742364459467549_1285
2013-10-31 16:15:51,301 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD from client DFSClient_-460164648
2013-10-31 16:15:51,301 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD is closed by DFSClient_-460164648
2013-10-31 16:15:51,302 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8290491646553836876_1295 size 26367
2013-10-31 16:15:51,302 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8290491646553836876_1295 size 26367
2013-10-31 16:15:51,309 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:51,309 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000002_0'
2013-10-31 16:15:51,310 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000003_0'
2013-10-31 16:15:51,310 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000005_0'
2013-10-31 16:15:51,311 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-661464544657018414 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:51,311 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-661464544657018414 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,311 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-661464544657018414 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,315 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0025_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:51,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025	dst=null	perm=null
2013-10-31 16:15:51,317 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-750470584501963121 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,317 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-750470584501963121 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:51,318 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-750470584501963121 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,318 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8206799160724257515 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:51,318 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8206799160724257515 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,318 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8206799160724257515 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,318 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2623433961007257862 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,319 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2623433961007257862 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,319 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2623433961007257862 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,319 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2558601193971908172 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,319 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2558601193971908172 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,320 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2558601193971908172 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:51,320 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7985283914289950420 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,320 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7985283914289950420 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,320 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7985283914289950420 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,320 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1719649238952092533 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,321 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1719649238952092533 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,321 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1719649238952092533 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,321 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8601652280056973022 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,321 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8601652280056973022 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,321 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8601652280056973022 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F	dst=null	perm=null
2013-10-31 16:15:51,329 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary
2013-10-31 16:15:51,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2013-10-31 16:15:51,349 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:15:51,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2013-10-31 16:15:51,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2013-10-31 16:15:51,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2013-10-31 16:15:51,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2013-10-31 16:15:51,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2013-10-31 16:15:51,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2013-10-31 16:15:51,359 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55915, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1107000733830591378_1291, duration: 779600
2013-10-31 16:15:51,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2013-10-31 16:15:51,364 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48913, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6384772226567960736_1290, duration: 259398
2013-10-31 16:15:51,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2013-10-31 16:15:51,367 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48914, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_9211691514110189620_1294, duration: 271068
2013-10-31 16:15:51,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2013-10-31 16:15:51,370 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55918, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4243449972058944542_1294, duration: 267624
2013-10-31 16:15:51,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2013-10-31 16:15:51,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35883, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8824242536225630163_1294, duration: 264888
2013-10-31 16:15:51,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2013-10-31 16:15:51,391 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:15:51,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2013-10-31 16:15:51,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2013-10-31 16:15:51,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2013-10-31 16:15:51,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2013-10-31 16:15:51,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2013-10-31 16:15:51,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2013-10-31 16:15:51,401 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35884, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1107000733830591378_1291, duration: 268078
2013-10-31 16:15:51,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2013-10-31 16:15:51,404 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35885, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6384772226567960736_1290, duration: 265876
2013-10-31 16:15:51,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2013-10-31 16:15:51,407 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35886, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9211691514110189620_1294, duration: 265869
2013-10-31 16:15:51,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2013-10-31 16:15:51,410 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48920, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4243449972058944542_1294, duration: 263367
2013-10-31 16:15:51,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2013-10-31 16:15:51,413 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35888, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8824242536225630163_1294, duration: 262104
2013-10-31 16:15:51,413 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinaroundjoinswapped
2013-10-31 16:15:51,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2013-10-31 16:15:51,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2013-10-31 16:15:51,422 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35820, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1107000733830591378_1291, duration: 257268
2013-10-31 16:15:51,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2013-10-31 16:15:51,426 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35890, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6384772226567960736_1290, duration: 264508
2013-10-31 16:15:51,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2013-10-31 16:15:51,430 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55927, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_9211691514110189620_1294, duration: 264304
2013-10-31 16:15:51,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2013-10-31 16:15:51,434 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55928, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4243449972058944542_1294, duration: 260466
2013-10-31 16:15:51,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2013-10-31 16:15:51,439 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35893, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8824242536225630163_1294, duration: 291504
2013-10-31 16:15:51,445 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7897376192076226208_1284 file build/test/data/dfs/data/data4/current/blk_-7897376192076226208 for deletion
2013-10-31 16:15:51,445 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3800742364459467549_1285 file build/test/data/dfs/data/data3/current/blk_-3800742364459467549 for deletion
2013-10-31 16:15:51,446 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7897376192076226208_1284 at file build/test/data/dfs/data/data4/current/blk_-7897376192076226208
2013-10-31 16:15:51,446 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002501081053343053_1283 file build/test/data/dfs/data/data3/current/blk_-3002501081053343053 for deletion
2013-10-31 16:15:51,446 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3800742364459467549_1285 at file build/test/data/dfs/data/data3/current/blk_-3800742364459467549
2013-10-31 16:15:51,447 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3515738870572374906_1286 file build/test/data/dfs/data/data4/current/blk_3515738870572374906 for deletion
2013-10-31 16:15:51,447 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002501081053343053_1283 at file build/test/data/dfs/data/data3/current/blk_-3002501081053343053
2013-10-31 16:15:51,447 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3515738870572374906_1286 at file build/test/data/dfs/data/data4/current/blk_3515738870572374906
2013-10-31 16:15:51,462 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:15:51,462 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:15:51,477 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0025
2013-10-31 16:15:51,477 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0025 being deleted.
2013-10-31 16:15:51,478 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000004_0'
2013-10-31 16:15:51,479 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:15:51,479 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:15:51,480 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:15:51,480 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch"]
2013-10-31 16:15:51,480 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:15:51,480 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 2
2013-10-31 16:15:51,480 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 2
2013-10-31 16:15:51,481 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2)
2013-10-31 16:15:51,484 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:15:51,484 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:15:51,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:51,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:15:51,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:51,505 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar. blk_-5219485888681558172_1296
2013-10-31 16:15:51,507 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5219485888681558172_1296 src: /127.0.0.1:35825 dest: /127.0.0.1:50942
2013-10-31 16:15:51,508 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5219485888681558172_1296 src: /127.0.0.1:48928 dest: /127.0.0.1:47311
2013-10-31 16:15:51,510 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5219485888681558172_1296 src: /127.0.0.1:35896 dest: /127.0.0.1:38271
2013-10-31 16:15:51,521 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35896, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5219485888681558172_1296, duration: 7555322
2013-10-31 16:15:51,522 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5219485888681558172_1296 terminating
2013-10-31 16:15:51,522 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48928, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5219485888681558172_1296, duration: 8421542
2013-10-31 16:15:51,523 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5219485888681558172_1296 terminating
2013-10-31 16:15:51,523 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35825, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5219485888681558172_1296, duration: 9319880
2013-10-31 16:15:51,524 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5219485888681558172_1296 terminating
2013-10-31 16:15:51,524 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5219485888681558172_1296 size 238055
2013-10-31 16:15:51,526 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar from client DFSClient_1457307213
2013-10-31 16:15:51,527 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar is closed by DFSClient_1457307213
2013-10-31 16:15:51,527 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5219485888681558172_1296 size 238055
2013-10-31 16:15:51,528 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5219485888681558172_1296 size 238055
2013-10-31 16:15:51,534 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar. New replication is 10
2013-10-31 16:15:51,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar	dst=null	perm=null
2013-10-31 16:15:51,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:51,548 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:15:51,553 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:15:51,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:15:51,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:51,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:51,568 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split. New replication is 10
2013-10-31 16:15:51,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split	dst=null	perm=null
2013-10-31 16:15:51,575 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split. blk_-1998638381933410712_1297
2013-10-31 16:15:51,577 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1998638381933410712_1297 src: /127.0.0.1:35897 dest: /127.0.0.1:38271
2013-10-31 16:15:51,578 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1998638381933410712_1297 src: /127.0.0.1:35829 dest: /127.0.0.1:50942
2013-10-31 16:15:51,580 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1998638381933410712_1297 src: /127.0.0.1:48932 dest: /127.0.0.1:47311
2013-10-31 16:15:51,582 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1998638381933410712_1297 src: /127.0.0.1:55936 dest: /127.0.0.1:41648
2013-10-31 16:15:51,585 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55936, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1998638381933410712_1297, duration: 1286489
2013-10-31 16:15:51,586 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1998638381933410712_1297 size 1732
2013-10-31 16:15:51,587 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1998638381933410712_1297 terminating
2013-10-31 16:15:51,589 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48932, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1998638381933410712_1297, duration: 146101
2013-10-31 16:15:51,589 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1998638381933410712_1297 terminating
2013-10-31 16:15:51,591 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1998638381933410712_1297 size 1732
2013-10-31 16:15:51,591 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35829, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1998638381933410712_1297, duration: 167957
2013-10-31 16:15:51,592 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1998638381933410712_1297 terminating
2013-10-31 16:15:51,592 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35897, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1998638381933410712_1297, duration: 3333834
2013-10-31 16:15:51,593 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-1998638381933410712_1297 terminating
2013-10-31 16:15:51,603 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1998638381933410712_1297 size 1732
2013-10-31 16:15:51,603 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split from client DFSClient_1457307213
2013-10-31 16:15:51,603 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split is closed by DFSClient_1457307213
2013-10-31 16:15:51,603 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1998638381933410712_1297 size 1732
2013-10-31 16:15:51,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,112 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo. blk_3074485234667118697_1298
2013-10-31 16:15:52,114 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3074485234667118697_1298 src: /127.0.0.1:35832 dest: /127.0.0.1:50942
2013-10-31 16:15:52,116 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3074485234667118697_1298 src: /127.0.0.1:48935 dest: /127.0.0.1:47311
2013-10-31 16:15:52,118 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3074485234667118697_1298 src: /127.0.0.1:55939 dest: /127.0.0.1:41648
2013-10-31 16:15:52,120 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55939, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3074485234667118697_1298, duration: 70270
2013-10-31 16:15:52,121 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3074485234667118697_1298 terminating
2013-10-31 16:15:52,121 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3074485234667118697_1298 size 183
2013-10-31 16:15:52,121 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48935, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3074485234667118697_1298, duration: 928229
2013-10-31 16:15:52,122 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3074485234667118697_1298 terminating
2013-10-31 16:15:52,122 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35832, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3074485234667118697_1298, duration: 2049635
2013-10-31 16:15:52,123 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3074485234667118697_1298 terminating
2013-10-31 16:15:52,126 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3074485234667118697_1298 size 183
2013-10-31 16:15:52,127 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:15:52,127 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:15:52,127 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3074485234667118697_1298 size 183
2013-10-31 16:15:52,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,151 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml. blk_-754354625884155761_1299
2013-10-31 16:15:52,152 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-754354625884155761_1299 src: /127.0.0.1:35835 dest: /127.0.0.1:50942
2013-10-31 16:15:52,154 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-754354625884155761_1299 src: /127.0.0.1:55941 dest: /127.0.0.1:41648
2013-10-31 16:15:52,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-754354625884155761_1299 src: /127.0.0.1:48939 dest: /127.0.0.1:47311
2013-10-31 16:15:52,159 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48939, dest: /127.0.0.1:47311, bytes: 28168, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-754354625884155761_1299, duration: 181407
2013-10-31 16:15:52,159 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-754354625884155761_1299 terminating
2013-10-31 16:15:52,160 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55941, dest: /127.0.0.1:41648, bytes: 28168, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-754354625884155761_1299, duration: 1020229
2013-10-31 16:15:52,160 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-754354625884155761_1299 terminating
2013-10-31 16:15:52,160 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35835, dest: /127.0.0.1:50942, bytes: 28168, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-754354625884155761_1299, duration: 1884575
2013-10-31 16:15:52,161 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-754354625884155761_1299 terminating
2013-10-31 16:15:52,164 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-754354625884155761_1299 size 28168
2013-10-31 16:15:52,164 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-754354625884155761_1299 size 28168
2013-10-31 16:15:52,165 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-754354625884155761_1299 size 28168
2013-10-31 16:15:52,564 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml from client DFSClient_1457307213
2013-10-31 16:15:52,565 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml is closed by DFSClient_1457307213
2013-10-31 16:15:52,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml	dst=null	perm=null
2013-10-31 16:15:52,579 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48941, bytes: 28392, op: HDFS_READ, cliID: DFSClient_311566579, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-754354625884155761_1299, duration: 388571
2013-10-31 16:15:52,597 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0026: nMaps=5 nReduces=1 max=-1
2013-10-31 16:15:52,598 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0026 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:15:52,598 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0026
2013-10-31 16:15:52,598 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0026	RESULT=SUCCESS
2013-10-31 16:15:52,598 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0026
2013-10-31 16:15:52,599 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0026
2013-10-31 16:15:52,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,630 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_conf.xml. blk_-7019503529854675644_1301
2013-10-31 16:15:52,631 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7019503529854675644_1301 src: /127.0.0.1:48942 dest: /127.0.0.1:47311
2013-10-31 16:15:52,632 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7019503529854675644_1301 src: /127.0.0.1:55946 dest: /127.0.0.1:41648
2013-10-31 16:15:52,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7019503529854675644_1301 src: /127.0.0.1:35911 dest: /127.0.0.1:38271
2013-10-31 16:15:52,636 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35911, dest: /127.0.0.1:38271, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7019503529854675644_1301, duration: 88306
2013-10-31 16:15:52,636 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7019503529854675644_1301 terminating
2013-10-31 16:15:52,636 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55946, dest: /127.0.0.1:41648, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7019503529854675644_1301, duration: 920579
2013-10-31 16:15:52,637 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7019503529854675644_1301 terminating
2013-10-31 16:15:52,637 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7019503529854675644_1301 size 28233
2013-10-31 16:15:52,637 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48942, dest: /127.0.0.1:47311, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7019503529854675644_1301, duration: 1872853
2013-10-31 16:15:52,638 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7019503529854675644_1301 terminating
2013-10-31 16:15:52,639 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_conf.xml from client DFSClient_311566579
2013-10-31 16:15:52,640 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_conf.xml is closed by DFSClient_311566579
2013-10-31 16:15:52,640 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7019503529854675644_1301 size 28233
2013-10-31 16:15:52,641 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7019503529854675644_1301 size 28233
2013-10-31 16:15:52,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,652 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken. blk_-3603487056913048693_1302
2013-10-31 16:15:52,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3603487056913048693_1302 src: /127.0.0.1:48945 dest: /127.0.0.1:47311
2013-10-31 16:15:52,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3603487056913048693_1302 src: /127.0.0.1:35913 dest: /127.0.0.1:38271
2013-10-31 16:15:52,655 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3603487056913048693_1302 src: /127.0.0.1:35845 dest: /127.0.0.1:50942
2013-10-31 16:15:52,656 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35845, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3603487056913048693_1302, duration: 712590
2013-10-31 16:15:52,657 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3603487056913048693_1302 terminating
2013-10-31 16:15:52,657 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35913, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3603487056913048693_1302, duration: 399884
2013-10-31 16:15:52,657 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3603487056913048693_1302 terminating
2013-10-31 16:15:52,657 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48945, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3603487056913048693_1302, duration: 802040
2013-10-31 16:15:52,658 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3603487056913048693_1302 terminating
2013-10-31 16:15:52,658 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3603487056913048693_1302 size 116
2013-10-31 16:15:52,660 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken from client DFSClient_1457307213
2013-10-31 16:15:52,660 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken is closed by DFSClient_1457307213
2013-10-31 16:15:52,661 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3603487056913048693_1302 size 116
2013-10-31 16:15:52,662 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3603487056913048693_1302 size 116
2013-10-31 16:15:52,664 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken
2013-10-31 16:15:52,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:15:52,666 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48948, bytes: 187, op: HDFS_READ, cliID: DFSClient_311566579, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3074485234667118697_1298, duration: 279282
2013-10-31 16:15:52,667 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0026 = 19. Number of splits = 5
2013-10-31 16:15:52,667 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0026 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:15:52,669 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0026 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:15:53,846 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7897376192076226208_1284 file build/test/data/dfs/data/data1/current/blk_-7897376192076226208 for deletion
2013-10-31 16:15:53,846 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3800742364459467549_1285 file build/test/data/dfs/data/data2/current/blk_-3800742364459467549 for deletion
2013-10-31 16:15:53,846 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7897376192076226208_1284 at file build/test/data/dfs/data/data1/current/blk_-7897376192076226208
2013-10-31 16:15:53,847 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3800742364459467549_1285 at file build/test/data/dfs/data/data2/current/blk_-3800742364459467549
2013-10-31 16:15:53,847 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002501081053343053_1283 file build/test/data/dfs/data/data2/current/blk_-3002501081053343053 for deletion
2013-10-31 16:15:53,847 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3515738870572374906_1286 file build/test/data/dfs/data/data1/current/blk_3515738870572374906 for deletion
2013-10-31 16:15:53,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002501081053343053_1283 at file build/test/data/dfs/data/data2/current/blk_-3002501081053343053
2013-10-31 16:15:53,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3515738870572374906_1286 at file build/test/data/dfs/data/data1/current/blk_3515738870572374906
2013-10-31 16:15:54,040 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0026_m_000006_0' to tip task_20131031160444934_0026_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:54,045 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000000_0'
2013-10-31 16:15:54,046 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000001_0'
2013-10-31 16:15:54,046 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000006_0'
2013-10-31 16:15:54,048 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:15:54,048 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000006_0 which needs 1 slots
2013-10-31 16:15:54,048 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000006_0 which needs 1 slots
2013-10-31 16:15:54,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken	dst=null	perm=null
2013-10-31 16:15:54,057 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35916, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3603487056913048693_1302, duration: 290900
2013-10-31 16:15:54,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml	dst=null	perm=null
2013-10-31 16:15:54,067 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48951, bytes: 28392, op: HDFS_READ, cliID: DFSClient_716493604, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-754354625884155761_1299, duration: 421913
2013-10-31 16:15:54,094 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:54,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar	dst=null	perm=null
2013-10-31 16:15:54,127 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35919, bytes: 239915, op: HDFS_READ, cliID: DFSClient_716493604, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5219485888681558172_1296, duration: 1540877
2013-10-31 16:15:54,221 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0025_m_-741228692
2013-10-31 16:15:54,227 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25634 with signal TERM. Exit code 0
2013-10-31 16:15:54,228 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_-1242438880
2013-10-31 16:15:54,229 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_-1242438880 spawned.
2013-10-31 16:15:54,230 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000006_0/taskjvm.sh
2013-10-31 16:15:54,301 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-5219485888681558172_1296 to datanode(s) 127.0.0.1:41648
2013-10-31 16:15:54,302 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-661464544657018414_1289 blk_-8601652280056973022_1281 blk_8206799160724257515_1275 blk_1719649238952092533_1281 blk_2623433961007257862_1277 blk_-7985283914289950420_1279
2013-10-31 16:15:54,302 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-750470584501963121_1282 blk_-661464544657018414_1289 blk_-8601652280056973022_1281 blk_8206799160724257515_1275 blk_1719649238952092533_1281 blk_2623433961007257862_1277 blk_-7985283914289950420_1279 blk_2558601193971908172_1278
2013-10-31 16:15:54,446 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-5219485888681558172_1296 to 127.0.0.1:41648 
2013-10-31 16:15:54,448 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5219485888681558172_1296 src: /127.0.0.1:55956 dest: /127.0.0.1:41648
2013-10-31 16:15:54,448 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-5219485888681558172_1296 to /127.0.0.1:41648
2013-10-31 16:15:54,451 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5219485888681558172_1296 src: /127.0.0.1:55956 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:15:54,455 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5219485888681558172_1296 size 238055
2013-10-31 16:15:54,606 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0025_m_-741228692
2013-10-31 16:15:56,312 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0025
2013-10-31 16:15:56,312 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000005_0 not found in cache
2013-10-31 16:15:56,312 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000002_0 not found in cache
2013-10-31 16:15:56,312 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000003_0 not found in cache
2013-10-31 16:15:56,313 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0025 for user-log deletion with retainTimeStamp:1383322556313
2013-10-31 16:15:56,480 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0025
2013-10-31 16:15:56,480 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000004_0 not found in cache
2013-10-31 16:15:56,481 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0025 for user-log deletion with retainTimeStamp:1383322556481
2013-10-31 16:15:56,542 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0025_m_-922718880 since job job_20131031160444934_0025 is dead
2013-10-31 16:15:56,546 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0025_m_38283024 since job job_20131031160444934_0025 is dead
2013-10-31 16:15:56,553 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25774 with signal TERM. Exit code 0
2013-10-31 16:15:56,557 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25745 with signal TERM. Exit code 0
2013-10-31 16:15:56,724 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:56,724 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:56,725 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:56,725 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_38283024 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:56,742 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:56,742 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:56,742 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:56,742 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_-922718880 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:56,847 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8601652280056973022_1281 file build/test/data/dfs/data/data2/current/blk_-8601652280056973022 for deletion
2013-10-31 16:15:56,847 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7985283914289950420_1279 file build/test/data/dfs/data/data2/current/blk_-7985283914289950420 for deletion
2013-10-31 16:15:56,847 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8601652280056973022_1281 at file build/test/data/dfs/data/data2/current/blk_-8601652280056973022
2013-10-31 16:15:56,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-750470584501963121_1282 file build/test/data/dfs/data/data1/current/blk_-750470584501963121 for deletion
2013-10-31 16:15:56,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7985283914289950420_1279 at file build/test/data/dfs/data/data2/current/blk_-7985283914289950420
2013-10-31 16:15:56,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-661464544657018414_1289 file build/test/data/dfs/data/data2/current/blk_-661464544657018414 for deletion
2013-10-31 16:15:56,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-750470584501963121_1282 at file build/test/data/dfs/data/data1/current/blk_-750470584501963121
2013-10-31 16:15:56,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-661464544657018414_1289 at file build/test/data/dfs/data/data2/current/blk_-661464544657018414
2013-10-31 16:15:56,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1719649238952092533_1281 file build/test/data/dfs/data/data1/current/blk_1719649238952092533 for deletion
2013-10-31 16:15:56,849 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2558601193971908172_1278 file build/test/data/dfs/data/data1/current/blk_2558601193971908172 for deletion
2013-10-31 16:15:56,849 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1719649238952092533_1281 at file build/test/data/dfs/data/data1/current/blk_1719649238952092533
2013-10-31 16:15:56,849 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2623433961007257862_1277 file build/test/data/dfs/data/data2/current/blk_2623433961007257862 for deletion
2013-10-31 16:15:56,850 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2558601193971908172_1278 at file build/test/data/dfs/data/data1/current/blk_2558601193971908172
2013-10-31 16:15:56,850 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2623433961007257862_1277 at file build/test/data/dfs/data/data2/current/blk_2623433961007257862
2013-10-31 16:15:56,850 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8206799160724257515_1275 file build/test/data/dfs/data/data2/current/blk_8206799160724257515 for deletion
2013-10-31 16:15:56,851 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8206799160724257515_1275 at file build/test/data/dfs/data/data2/current/blk_8206799160724257515
2013-10-31 16:15:56,994 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0025_m_331774167 since job job_20131031160444934_0025 is dead
2013-10-31 16:15:57,004 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25710 with signal TERM. Exit code 0
2013-10-31 16:15:57,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8601652280056973022_1281 file build/test/data/dfs/data/data7/current/blk_-8601652280056973022 for deletion
2013-10-31 16:15:57,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7985283914289950420_1279 file build/test/data/dfs/data/data7/current/blk_-7985283914289950420 for deletion
2013-10-31 16:15:57,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8601652280056973022_1281 at file build/test/data/dfs/data/data7/current/blk_-8601652280056973022
2013-10-31 16:15:57,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-661464544657018414_1289 file build/test/data/dfs/data/data7/current/blk_-661464544657018414 for deletion
2013-10-31 16:15:57,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7985283914289950420_1279 at file build/test/data/dfs/data/data7/current/blk_-7985283914289950420
2013-10-31 16:15:57,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1719649238952092533_1281 file build/test/data/dfs/data/data8/current/blk_1719649238952092533 for deletion
2013-10-31 16:15:57,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-661464544657018414_1289 at file build/test/data/dfs/data/data7/current/blk_-661464544657018414
2013-10-31 16:15:57,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2623433961007257862_1277 file build/test/data/dfs/data/data8/current/blk_2623433961007257862 for deletion
2013-10-31 16:15:57,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1719649238952092533_1281 at file build/test/data/dfs/data/data8/current/blk_1719649238952092533
2013-10-31 16:15:57,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8206799160724257515_1275 file build/test/data/dfs/data/data8/current/blk_8206799160724257515 for deletion
2013-10-31 16:15:57,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2623433961007257862_1277 at file build/test/data/dfs/data/data8/current/blk_2623433961007257862
2013-10-31 16:15:57,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8206799160724257515_1275 at file build/test/data/dfs/data/data8/current/blk_8206799160724257515
2013-10-31 16:15:57,176 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:57,176 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:57,176 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:57,177 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_331774167 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:15:57,303 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-750470584501963121_1282 blk_-8601652280056973022_1281 blk_1719649238952092533_1281 blk_2623433961007257862_1277 blk_-7985283914289950420_1279 blk_2558601193971908172_1278
2013-10-31 16:15:57,303 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-750470584501963121_1282 blk_-661464544657018414_1289 blk_8206799160724257515_1275 blk_2558601193971908172_1278
2013-10-31 16:15:57,447 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-750470584501963121_1282 file build/test/data/dfs/data/data4/current/blk_-750470584501963121 for deletion
2013-10-31 16:15:57,447 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-661464544657018414_1289 file build/test/data/dfs/data/data4/current/blk_-661464544657018414 for deletion
2013-10-31 16:15:57,447 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-750470584501963121_1282 at file build/test/data/dfs/data/data4/current/blk_-750470584501963121
2013-10-31 16:15:57,447 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2558601193971908172_1278 file build/test/data/dfs/data/data3/current/blk_2558601193971908172 for deletion
2013-10-31 16:15:57,448 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-661464544657018414_1289 at file build/test/data/dfs/data/data4/current/blk_-661464544657018414
2013-10-31 16:15:57,448 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8206799160724257515_1275 file build/test/data/dfs/data/data4/current/blk_8206799160724257515 for deletion
2013-10-31 16:15:57,448 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2558601193971908172_1278 at file build/test/data/dfs/data/data3/current/blk_2558601193971908172
2013-10-31 16:15:57,448 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8206799160724257515_1275 at file build/test/data/dfs/data/data4/current/blk_8206799160724257515
2013-10-31 16:15:57,864 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:57,864 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:57,864 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:57,864 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_-741228692 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:58,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8601652280056973022_1281 file build/test/data/dfs/data/data5/current/blk_-8601652280056973022 for deletion
2013-10-31 16:15:58,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7985283914289950420_1279 file build/test/data/dfs/data/data5/current/blk_-7985283914289950420 for deletion
2013-10-31 16:15:58,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8601652280056973022_1281 at file build/test/data/dfs/data/data5/current/blk_-8601652280056973022
2013-10-31 16:15:58,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-750470584501963121_1282 file build/test/data/dfs/data/data6/current/blk_-750470584501963121 for deletion
2013-10-31 16:15:58,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7985283914289950420_1279 at file build/test/data/dfs/data/data5/current/blk_-7985283914289950420
2013-10-31 16:15:58,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1719649238952092533_1281 file build/test/data/dfs/data/data6/current/blk_1719649238952092533 for deletion
2013-10-31 16:15:58,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-750470584501963121_1282 at file build/test/data/dfs/data/data6/current/blk_-750470584501963121
2013-10-31 16:15:58,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2558601193971908172_1278 file build/test/data/dfs/data/data6/current/blk_2558601193971908172 for deletion
2013-10-31 16:15:58,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1719649238952092533_1281 at file build/test/data/dfs/data/data6/current/blk_1719649238952092533
2013-10-31 16:15:58,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2623433961007257862_1277 file build/test/data/dfs/data/data5/current/blk_2623433961007257862 for deletion
2013-10-31 16:15:58,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2558601193971908172_1278 at file build/test/data/dfs/data/data6/current/blk_2558601193971908172
2013-10-31 16:15:58,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2623433961007257862_1277 at file build/test/data/dfs/data/data5/current/blk_2623433961007257862
2013-10-31 16:15:58,505 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_-1242438880 given task: attempt_20131031160444934_0026_m_000006_0
2013-10-31 16:15:59,048 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0025
2013-10-31 16:15:59,048 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000001_0 not found in cache
2013-10-31 16:15:59,048 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000000_0 not found in cache
2013-10-31 16:15:59,049 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0025 for user-log deletion with retainTimeStamp:1383322559049
2013-10-31 16:15:59,050 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1612 Total time for transactions(ms): 36Number of transactions batched in Syncs: 172 Number of syncs: 1156 SyncTimes(ms): 49876 11492 
2013-10-31 16:15:59,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:59,800 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0025_m_-2015129647 since job job_20131031160444934_0025 is dead
2013-10-31 16:15:59,810 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25489 with signal TERM. Exit code 0
2013-10-31 16:15:59,992 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:59,993 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:59,993 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:15:59,993 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_-2015129647 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:16:01,964 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000006_0 0.0% setup
2013-10-31 16:16:01,967 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000006_0 is done.
2013-10-31 16:16:01,967 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000006_0  was -1
2013-10-31 16:16:01,967 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:03,054 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000006_0' has completed task_20131031160444934_0026_m_000006 successfully.
2013-10-31 16:16:03,057 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000000_0' to tip task_20131031160444934_0026_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:03,058 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000000
2013-10-31 16:16:03,059 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000001_0' to tip task_20131031160444934_0026_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:03,059 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000001
2013-10-31 16:16:03,061 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:16:03,062 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:16:03,063 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000000_0 which needs 1 slots
2013-10-31 16:16:03,063 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000000_0 which needs 1 slots
2013-10-31 16:16:03,063 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000001_0 which needs 1 slots
2013-10-31 16:16:03,064 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0026_m_000001_0 which needs 1 slots
2013-10-31 16:16:03,104 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_-851400586
2013-10-31 16:16:03,105 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_-851400586 spawned.
2013-10-31 16:16:03,105 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0026/attempt_20131031160444934_0026_m_000001_0. Attempting to reuse: jvm_20131031160444934_0026_m_-1242438880
2013-10-31 16:16:03,106 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000000_0/taskjvm.sh
2013-10-31 16:16:03,327 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000002_0' to tip task_20131031160444934_0026_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:03,327 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000002
2013-10-31 16:16:03,328 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000003_0' to tip task_20131031160444934_0026_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:03,328 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000003
2013-10-31 16:16:03,330 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:16:03,331 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:16:03,331 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000002_0 which needs 1 slots
2013-10-31 16:16:03,331 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000002_0 which needs 1 slots
2013-10-31 16:16:03,331 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000003_0 which needs 1 slots
2013-10-31 16:16:03,332 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0026_m_000003_0 which needs 1 slots
2013-10-31 16:16:03,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken	dst=null	perm=null
2013-10-31 16:16:03,339 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48958, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3603487056913048693_1302, duration: 278296
2013-10-31 16:16:03,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml	dst=null	perm=null
2013-10-31 16:16:03,347 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48960, bytes: 28392, op: HDFS_READ, cliID: DFSClient_-379393667, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-754354625884155761_1299, duration: 373716
2013-10-31 16:16:03,368 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:03,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar	dst=null	perm=null
2013-10-31 16:16:03,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55964, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-379393667, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5219485888681558172_1296, duration: 1456671
2013-10-31 16:16:03,447 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_790658481
2013-10-31 16:16:03,448 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_790658481 spawned.
2013-10-31 16:16:03,449 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_1084653767
2013-10-31 16:16:03,449 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_1084653767 spawned.
2013-10-31 16:16:03,450 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000002_0/taskjvm.sh
2013-10-31 16:16:03,451 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000003_0/taskjvm.sh
2013-10-31 16:16:03,489 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000004_0' to tip task_20131031160444934_0026_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:16:03,489 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000004
2013-10-31 16:16:03,490 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:16:03,490 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000004_0 which needs 1 slots
2013-10-31 16:16:03,490 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000004_0 which needs 1 slots
2013-10-31 16:16:03,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken	dst=null	perm=null
2013-10-31 16:16:03,494 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35929, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3603487056913048693_1302, duration: 134634
2013-10-31 16:16:03,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml	dst=null	perm=null
2013-10-31 16:16:03,498 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35862, bytes: 28392, op: HDFS_READ, cliID: DFSClient_1428518159, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-754354625884155761_1299, duration: 150213
2013-10-31 16:16:03,510 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:03,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar	dst=null	perm=null
2013-10-31 16:16:03,523 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35863, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1428518159, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5219485888681558172_1296, duration: 626811
2013-10-31 16:16:03,531 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_-1242438880 given task: attempt_20131031160444934_0026_m_000001_0
2013-10-31 16:16:03,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split	dst=null	perm=null
2013-10-31 16:16:03,630 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48967, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1998638381933410712_1297, duration: 158292
2013-10-31 16:16:03,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:16:03,670 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35866, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 110803
2013-10-31 16:16:03,902 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_1344813911
2013-10-31 16:16:03,903 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_1344813911 spawned.
2013-10-31 16:16:03,904 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000004_0/taskjvm.sh
2013-10-31 16:16:03,950 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_-851400586 given task: attempt_20131031160444934_0026_m_000000_0
2013-10-31 16:16:04,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split	dst=null	perm=null
2013-10-31 16:16:04,449 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35938, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1998638381933410712_1297, duration: 170704
2013-10-31 16:16:04,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:16:04,679 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_790658481 given task: attempt_20131031160444934_0026_m_000002_0
2013-10-31 16:16:04,739 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55976, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 124677
2013-10-31 16:16:05,140 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_1084653767 given task: attempt_20131031160444934_0026_m_000003_0
2013-10-31 16:16:05,173 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_1344813911 given task: attempt_20131031160444934_0026_m_000004_0
2013-10-31 16:16:05,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split	dst=null	perm=null
2013-10-31 16:16:05,209 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48977, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1998638381933410712_1297, duration: 167481
2013-10-31 16:16:05,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:16:05,248 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48978, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 126175
2013-10-31 16:16:05,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split	dst=null	perm=null
2013-10-31 16:16:05,640 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55984, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1998638381933410712_1297, duration: 165384
2013-10-31 16:16:05,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split	dst=null	perm=null
2013-10-31 16:16:05,671 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35880, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1998638381933410712_1297, duration: 436914
2013-10-31 16:16:05,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:16:05,680 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35881, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 257299
2013-10-31 16:16:05,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:16:05,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35882, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 232018
2013-10-31 16:16:06,598 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:16:06,601 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000001_0 is done.
2013-10-31 16:16:06,601 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000001_0  was 6
2013-10-31 16:16:06,601 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:16:07,377 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:16:07,380 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000000_0 is done.
2013-10-31 16:16:07,380 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000000_0  was 6
2013-10-31 16:16:07,380 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:08,063 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0026_m_000006_0
2013-10-31 16:16:08,063 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0026_m_000006_0
2013-10-31 16:16:08,063 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0026_m_000006_0 not found in cache
2013-10-31 16:16:08,136 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:16:08,138 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000002_0 is done.
2013-10-31 16:16:08,139 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000002_0  was 6
2013-10-31 16:16:08,139 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:16:08,568 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:16:08,571 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000003_0 is done.
2013-10-31 16:16:08,571 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000003_0  was 6
2013-10-31 16:16:08,571 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:08,596 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:16:08,598 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000004_0 is done.
2013-10-31 16:16:08,598 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000004_0  was 6
2013-10-31 16:16:08,599 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:09,067 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000000_0' has completed task_20131031160444934_0026_m_000000 successfully.
2013-10-31 16:16:09,242 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000001_0' has completed task_20131031160444934_0026_m_000001 successfully.
2013-10-31 16:16:09,244 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0026_r_000000_0' to tip task_20131031160444934_0026_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:09,247 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:16:09,247 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_r_000000_0 which needs 1 slots
2013-10-31 16:16:09,247 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_r_000000_0 which needs 1 slots
2013-10-31 16:16:09,291 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_r_-1130629699
2013-10-31 16:16:09,292 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_r_-1130629699 spawned.
2013-10-31 16:16:09,293 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_r_000000_0/taskjvm.sh
2013-10-31 16:16:09,337 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000002_0' has completed task_20131031160444934_0026_m_000002 successfully.
2013-10-31 16:16:09,415 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000003_0' has completed task_20131031160444934_0026_m_000003 successfully.
2013-10-31 16:16:09,494 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000004_0' has completed task_20131031160444934_0026_m_000004 successfully.
2013-10-31 16:16:10,008 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 72 raw values into 1 aggregated values, total 31
2013-10-31 16:16:10,209 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_r_-1130629699 given task: attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:15,916 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:47678, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000000_0, duration: 10706306
2013-10-31 16:16:15,943 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:47678, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000001_0, duration: 11821829
2013-10-31 16:16:15,960 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:48486, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000002_0, duration: 12248640
2013-10-31 16:16:15,977 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:48486, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000003_0, duration: 13400352
2013-10-31 16:16:15,993 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:59612, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000004_0, duration: 11869067
2013-10-31 16:16:16,709 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:16:16,750 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:16:16,811 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:16:17,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:17,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:17,022 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000. blk_-5924082644072865753_1303
2013-10-31 16:16:17,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5924082644072865753_1303 src: /127.0.0.1:35958 dest: /127.0.0.1:38271
2013-10-31 16:16:17,045 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5924082644072865753_1303 src: /127.0.0.1:48992 dest: /127.0.0.1:47311
2013-10-31 16:16:17,045 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5924082644072865753_1303 src: /127.0.0.1:35891 dest: /127.0.0.1:50942
2013-10-31 16:16:17,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35891, dest: /127.0.0.1:50942, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0026_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5924082644072865753_1303, duration: 892532
2013-10-31 16:16:17,047 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5924082644072865753_1303 terminating
2013-10-31 16:16:17,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48992, dest: /127.0.0.1:47311, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0026_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5924082644072865753_1303, duration: 1228164
2013-10-31 16:16:17,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5924082644072865753_1303 terminating
2013-10-31 16:16:17,050 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35958, dest: /127.0.0.1:38271, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0026_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5924082644072865753_1303, duration: 3525481
2013-10-31 16:16:17,050 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5924082644072865753_1303 size 70
2013-10-31 16:16:17,050 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5924082644072865753_1303 terminating
2013-10-31 16:16:17,052 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5924082644072865753_1303 size 70
2013-10-31 16:16:17,053 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:17,053 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:17,054 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5924082644072865753_1303 size 70
2013-10-31 16:16:17,103 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0026_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:17,103 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:16:18,256 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031160444934_0026_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:16:18,257 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:19,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0	dst=null	perm=null
2013-10-31 16:16:19,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:19,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:19,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0	dst=null	perm=null
2013-10-31 16:16:19,760 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 16:16:19,762 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 16:16:19,763 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_r_000000_0 is done.
2013-10-31 16:16:19,763 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_r_000000_0  was -1
2013-10-31 16:16:19,763 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:21,261 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_r_000000_0' has completed task_20131031160444934_0026_r_000000 successfully.
2013-10-31 16:16:21,264 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0026_m_000005_0' to tip task_20131031160444934_0026_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:21,267 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:16:21,267 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000005_0 which needs 1 slots
2013-10-31 16:16:21,267 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000005_0 which needs 1 slots
2013-10-31 16:16:21,325 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0026/attempt_20131031160444934_0026_m_000005_0. Attempting to reuse: jvm_20131031160444934_0026_m_-1242438880
2013-10-31 16:16:22,146 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_-1242438880 given task: attempt_20131031160444934_0026_m_000005_0
2013-10-31 16:16:22,264 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000005_0 0.0% 
2013-10-31 16:16:22,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary	dst=null	perm=null
2013-10-31 16:16:22,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:22,375 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_SUCCESS from client DFSClient_attempt_20131031160444934_0026_m_000005_0
2013-10-31 16:16:22,376 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0026_m_000005_0
2013-10-31 16:16:22,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5219485888681558172 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:22,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5219485888681558172 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:22,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5219485888681558172 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:22,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5219485888681558172 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:22,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1998638381933410712 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:22,418 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1998638381933410712 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:22,418 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1998638381933410712 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:22,418 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1998638381933410712 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:22,418 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3074485234667118697 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:22,419 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3074485234667118697 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:22,419 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3074485234667118697 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:22,419 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-754354625884155761 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:22,419 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-754354625884155761 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:22,419 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-754354625884155761 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:22,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026	dst=null	perm=null
2013-10-31 16:16:24,308 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-1998638381933410712_1297 blk_-5219485888681558172_1296 blk_-754354625884155761_1299 blk_3074485234667118697_1298
2013-10-31 16:16:24,308 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-1998638381933410712_1297 blk_-5219485888681558172_1296 blk_-754354625884155761_1299 blk_3074485234667118697_1298
2013-10-31 16:16:25,069 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5219485888681558172_1296 file build/test/data/dfs/data/data5/current/blk_-5219485888681558172 for deletion
2013-10-31 16:16:25,069 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1998638381933410712_1297 file build/test/data/dfs/data/data5/current/blk_-1998638381933410712 for deletion
2013-10-31 16:16:25,070 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-754354625884155761_1299 file build/test/data/dfs/data/data5/current/blk_-754354625884155761 for deletion
2013-10-31 16:16:25,070 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5219485888681558172_1296 at file build/test/data/dfs/data/data5/current/blk_-5219485888681558172
2013-10-31 16:16:25,070 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3074485234667118697_1298 file build/test/data/dfs/data/data6/current/blk_3074485234667118697 for deletion
2013-10-31 16:16:25,070 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1998638381933410712_1297 at file build/test/data/dfs/data/data5/current/blk_-1998638381933410712
2013-10-31 16:16:25,070 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3074485234667118697_1298 at file build/test/data/dfs/data/data6/current/blk_3074485234667118697
2013-10-31 16:16:25,071 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-754354625884155761_1299 at file build/test/data/dfs/data/data5/current/blk_-754354625884155761
2013-10-31 16:16:25,239 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000005_0 0.0% cleanup
2013-10-31 16:16:25,241 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000005_0 is done.
2013-10-31 16:16:25,241 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000005_0  was -1
2013-10-31 16:16:25,241 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:26,267 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:26,267 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:27,067 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5219485888681558172_1296 file build/test/data/dfs/data/data8/current/blk_-5219485888681558172 for deletion
2013-10-31 16:16:27,067 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1998638381933410712_1297 file build/test/data/dfs/data/data7/current/blk_-1998638381933410712 for deletion
2013-10-31 16:16:27,067 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-754354625884155761_1299 file build/test/data/dfs/data/data7/current/blk_-754354625884155761 for deletion
2013-10-31 16:16:27,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1998638381933410712_1297 at file build/test/data/dfs/data/data7/current/blk_-1998638381933410712
2013-10-31 16:16:27,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3074485234667118697_1298 file build/test/data/dfs/data/data8/current/blk_3074485234667118697 for deletion
2013-10-31 16:16:27,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-754354625884155761_1299 at file build/test/data/dfs/data/data7/current/blk_-754354625884155761
2013-10-31 16:16:27,067 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5219485888681558172_1296 at file build/test/data/dfs/data/data8/current/blk_-5219485888681558172
2013-10-31 16:16:27,069 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3074485234667118697_1298 at file build/test/data/dfs/data/data8/current/blk_3074485234667118697
2013-10-31 16:16:27,274 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000005_0' has completed task_20131031160444934_0026_m_000005 successfully.
2013-10-31 16:16:27,275 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0026 has completed successfully.
2013-10-31 16:16:27,275 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0026,submitTime=1383236152569,launchTime=1383236152668,firstMapTaskLaunchTime=1383236163057,firstReduceTaskLaunchTime=1383236169244,firstJobSetupTaskLaunchTime=1383236154040,firstJobCleanupTaskLaunchTime=1383236181264,finishTime=1383236187275,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D198DEC2FB1E42BAA7C2368DEA5C9FEF/4D61CF86ECC94701B9ED8A67A271C801] lower*upper/(2/2)
2013-10-31 16:16:27,279 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701. blk_-6262429360302313689_1304
2013-10-31 16:16:27,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6262429360302313689_1304 src: /127.0.0.1:35894 dest: /127.0.0.1:50942
2013-10-31 16:16:27,286 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6262429360302313689_1304 src: /127.0.0.1:48997 dest: /127.0.0.1:47311
2013-10-31 16:16:27,287 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6262429360302313689_1304 src: /127.0.0.1:35965 dest: /127.0.0.1:38271
2013-10-31 16:16:27,297 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35965, dest: /127.0.0.1:38271, bytes: 29744, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6262429360302313689_1304, duration: 5787872
2013-10-31 16:16:27,298 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6262429360302313689_1304 terminating
2013-10-31 16:16:27,298 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48997, dest: /127.0.0.1:47311, bytes: 29744, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6262429360302313689_1304, duration: 5965430
2013-10-31 16:16:27,299 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6262429360302313689_1304 terminating
2013-10-31 16:16:27,299 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6262429360302313689_1304 size 29744
2013-10-31 16:16:27,299 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35894, dest: /127.0.0.1:50942, bytes: 29744, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6262429360302313689_1304, duration: 5044582
2013-10-31 16:16:27,299 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6262429360302313689_1304 size 29744
2013-10-31 16:16:27,300 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6262429360302313689_1304 terminating
2013-10-31 16:16:27,302 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6262429360302313689_1304 size 29744
2013-10-31 16:16:27,303 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701 from client DFSClient_311566579
2013-10-31 16:16:27,303 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701 is closed by DFSClient_311566579
2013-10-31 16:16:27,309 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-1998638381933410712_1297 blk_-5219485888681558172_1296 blk_-754354625884155761_1299 blk_3074485234667118697_1298
2013-10-31 16:16:27,309 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-1998638381933410712_1297 blk_-5219485888681558172_1296
2013-10-31 16:16:27,313 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:16:27,314 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000000_0'
2013-10-31 16:16:27,314 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000001_0'
2013-10-31 16:16:27,314 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000005_0'
2013-10-31 16:16:27,316 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000006_0'
2013-10-31 16:16:27,316 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3603487056913048693 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:27,316 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_r_000000_0'
2013-10-31 16:16:27,316 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3603487056913048693 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:27,317 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3603487056913048693 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:27,319 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0026_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:16:27,320 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2) ...atform/joinfilteredbranch
2013-10-31 16:16:27,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026	dst=null	perm=null
2013-10-31 16:16:27,327 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:16:27,327 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:16:27,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:27,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:16:27,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,353 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar. blk_6563616459556469136_1305
2013-10-31 16:16:27,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6563616459556469136_1305 src: /127.0.0.1:56003 dest: /127.0.0.1:41648
2013-10-31 16:16:27,356 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6563616459556469136_1305 src: /127.0.0.1:49001 dest: /127.0.0.1:47311
2013-10-31 16:16:27,358 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6563616459556469136_1305 src: /127.0.0.1:35900 dest: /127.0.0.1:50942
2013-10-31 16:16:27,368 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35900, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6563616459556469136_1305, duration: 6669020
2013-10-31 16:16:27,368 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6563616459556469136_1305 terminating
2013-10-31 16:16:27,368 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49001, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6563616459556469136_1305, duration: 7494879
2013-10-31 16:16:27,369 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6563616459556469136_1305 terminating
2013-10-31 16:16:27,369 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56003, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6563616459556469136_1305, duration: 8311793
2013-10-31 16:16:27,370 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6563616459556469136_1305 terminating
2013-10-31 16:16:27,370 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6563616459556469136_1305 size 238055
2013-10-31 16:16:27,371 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar from client DFSClient_1457307213
2013-10-31 16:16:27,372 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar is closed by DFSClient_1457307213
2013-10-31 16:16:27,372 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6563616459556469136_1305 size 238055
2013-10-31 16:16:27,373 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6563616459556469136_1305 size 238055
2013-10-31 16:16:27,377 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar. New replication is 10
2013-10-31 16:16:27,437 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000002_0'
2013-10-31 16:16:27,437 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000003_0'
2013-10-31 16:16:27,457 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5219485888681558172_1296 file build/test/data/dfs/data/data3/current/blk_-5219485888681558172 for deletion
2013-10-31 16:16:27,457 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1998638381933410712_1297 file build/test/data/dfs/data/data4/current/blk_-1998638381933410712 for deletion
2013-10-31 16:16:27,457 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5219485888681558172_1296 at file build/test/data/dfs/data/data3/current/blk_-5219485888681558172
2013-10-31 16:16:27,457 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1998638381933410712_1297 at file build/test/data/dfs/data/data4/current/blk_-1998638381933410712
2013-10-31 16:16:27,457 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-754354625884155761_1299 file build/test/data/dfs/data/data4/current/blk_-754354625884155761 for deletion
2013-10-31 16:16:27,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3074485234667118697_1298 file build/test/data/dfs/data/data3/current/blk_3074485234667118697 for deletion
2013-10-31 16:16:27,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-754354625884155761_1299 at file build/test/data/dfs/data/data4/current/blk_-754354625884155761
2013-10-31 16:16:27,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3074485234667118697_1298 at file build/test/data/dfs/data/data3/current/blk_3074485234667118697
2013-10-31 16:16:27,514 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0026
2013-10-31 16:16:27,514 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0026 being deleted.
2013-10-31 16:16:27,514 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000004_0'
2013-10-31 16:16:27,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar	dst=null	perm=null
2013-10-31 16:16:27,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,879 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:16:27,883 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:16:27,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:16:27,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,899 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split. New replication is 10
2013-10-31 16:16:27,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split	dst=null	perm=null
2013-10-31 16:16:27,906 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split. blk_-6529624484255616460_1306
2013-10-31 16:16:27,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6529624484255616460_1306 src: /127.0.0.1:35901 dest: /127.0.0.1:50942
2013-10-31 16:16:27,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6529624484255616460_1306 src: /127.0.0.1:56007 dest: /127.0.0.1:41648
2013-10-31 16:16:27,911 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6529624484255616460_1306 src: /127.0.0.1:49005 dest: /127.0.0.1:47311
2013-10-31 16:16:27,913 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6529624484255616460_1306 src: /127.0.0.1:35973 dest: /127.0.0.1:38271
2013-10-31 16:16:27,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35973, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6529624484255616460_1306, duration: 101457
2013-10-31 16:16:27,917 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6529624484255616460_1306 terminating
2013-10-31 16:16:27,917 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49005, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6529624484255616460_1306, duration: 934455
2013-10-31 16:16:27,918 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6529624484255616460_1306 terminating
2013-10-31 16:16:27,918 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6529624484255616460_1306 size 1732
2013-10-31 16:16:27,918 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56007, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6529624484255616460_1306, duration: 1916986
2013-10-31 16:16:27,919 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6529624484255616460_1306 terminating
2013-10-31 16:16:27,919 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35901, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6529624484255616460_1306, duration: 2929703
2013-10-31 16:16:27,920 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-6529624484255616460_1306 terminating
2013-10-31 16:16:27,921 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6529624484255616460_1306 size 1732
2013-10-31 16:16:27,921 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split from client DFSClient_1457307213
2013-10-31 16:16:27,922 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split is closed by DFSClient_1457307213
2013-10-31 16:16:27,922 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6529624484255616460_1306 size 1732
2013-10-31 16:16:27,923 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6529624484255616460_1306 size 1732
2013-10-31 16:16:27,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,941 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo. blk_-2701757164713452030_1307
2013-10-31 16:16:27,942 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2701757164713452030_1307 src: /127.0.0.1:56010 dest: /127.0.0.1:41648
2013-10-31 16:16:27,944 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2701757164713452030_1307 src: /127.0.0.1:49008 dest: /127.0.0.1:47311
2013-10-31 16:16:27,945 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2701757164713452030_1307 src: /127.0.0.1:35976 dest: /127.0.0.1:38271
2013-10-31 16:16:27,948 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35976, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2701757164713452030_1307, duration: 69861
2013-10-31 16:16:27,948 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2701757164713452030_1307 terminating
2013-10-31 16:16:27,949 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49008, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2701757164713452030_1307, duration: 897630
2013-10-31 16:16:27,949 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2701757164713452030_1307 terminating
2013-10-31 16:16:27,950 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56010, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2701757164713452030_1307, duration: 1805797
2013-10-31 16:16:27,950 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2701757164713452030_1307 terminating
2013-10-31 16:16:27,951 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2701757164713452030_1307 size 183
2013-10-31 16:16:27,954 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:16:27,954 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:16:27,955 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2701757164713452030_1307 size 183
2013-10-31 16:16:27,955 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2701757164713452030_1307 size 183
2013-10-31 16:16:27,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,979 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml. blk_58242616522772820_1308
2013-10-31 16:16:27,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_58242616522772820_1308 src: /127.0.0.1:56013 dest: /127.0.0.1:41648
2013-10-31 16:16:27,982 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_58242616522772820_1308 src: /127.0.0.1:35909 dest: /127.0.0.1:50942
2013-10-31 16:16:27,983 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_58242616522772820_1308 src: /127.0.0.1:49012 dest: /127.0.0.1:47311
2013-10-31 16:16:27,986 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49012, dest: /127.0.0.1:47311, bytes: 28747, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_58242616522772820_1308, duration: 236453
2013-10-31 16:16:27,987 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_58242616522772820_1308 terminating
2013-10-31 16:16:27,987 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35909, dest: /127.0.0.1:50942, bytes: 28747, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_58242616522772820_1308, duration: 1111772
2013-10-31 16:16:27,988 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_58242616522772820_1308 terminating
2013-10-31 16:16:27,988 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_58242616522772820_1308 size 28747
2013-10-31 16:16:27,988 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56013, dest: /127.0.0.1:41648, bytes: 28747, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_58242616522772820_1308, duration: 1911285
2013-10-31 16:16:27,988 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_58242616522772820_1308 size 28747
2013-10-31 16:16:27,989 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_58242616522772820_1308 terminating
2013-10-31 16:16:27,990 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml from client DFSClient_1457307213
2013-10-31 16:16:27,991 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml is closed by DFSClient_1457307213
2013-10-31 16:16:27,992 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_58242616522772820_1308 size 28747
2013-10-31 16:16:28,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml	dst=null	perm=null
2013-10-31 16:16:28,009 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56017, bytes: 28975, op: HDFS_READ, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_58242616522772820_1308, duration: 381221
2013-10-31 16:16:28,024 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0027: nMaps=5 nReduces=0 max=-1
2013-10-31 16:16:28,024 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0027 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:16:28,025 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0027	RESULT=SUCCESS
2013-10-31 16:16:28,025 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0027
2013-10-31 16:16:28,025 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0027
2013-10-31 16:16:28,025 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0027
2013-10-31 16:16:28,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:28,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:28,460 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_conf.xml. blk_-8398817715825442056_1310
2013-10-31 16:16:28,461 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8398817715825442056_1310 src: /127.0.0.1:56018 dest: /127.0.0.1:41648
2013-10-31 16:16:28,463 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8398817715825442056_1310 src: /127.0.0.1:35983 dest: /127.0.0.1:38271
2013-10-31 16:16:28,465 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8398817715825442056_1310 src: /127.0.0.1:35915 dest: /127.0.0.1:50942
2013-10-31 16:16:28,469 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35915, dest: /127.0.0.1:50942, bytes: 28812, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8398817715825442056_1310, duration: 591008
2013-10-31 16:16:28,469 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8398817715825442056_1310 terminating
2013-10-31 16:16:28,470 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35983, dest: /127.0.0.1:38271, bytes: 28812, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8398817715825442056_1310, duration: 1809347
2013-10-31 16:16:28,470 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8398817715825442056_1310 terminating
2013-10-31 16:16:28,471 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8398817715825442056_1310 size 28812
2013-10-31 16:16:28,471 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56018, dest: /127.0.0.1:41648, bytes: 28812, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8398817715825442056_1310, duration: 2427823
2013-10-31 16:16:28,471 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8398817715825442056_1310 terminating
2013-10-31 16:16:28,473 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8398817715825442056_1310 size 28812
2013-10-31 16:16:28,473 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_conf.xml from client DFSClient_-355221738
2013-10-31 16:16:28,474 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_conf.xml is closed by DFSClient_-355221738
2013-10-31 16:16:28,474 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8398817715825442056_1310 size 28812
2013-10-31 16:16:28,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:28,488 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken. blk_-9043489202376737003_1311
2013-10-31 16:16:28,490 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9043489202376737003_1311 src: /127.0.0.1:35985 dest: /127.0.0.1:38271
2013-10-31 16:16:28,491 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9043489202376737003_1311 src: /127.0.0.1:56022 dest: /127.0.0.1:41648
2013-10-31 16:16:28,493 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9043489202376737003_1311 src: /127.0.0.1:35918 dest: /127.0.0.1:50942
2013-10-31 16:16:28,496 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35918, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9043489202376737003_1311, duration: 62724
2013-10-31 16:16:28,496 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9043489202376737003_1311 terminating
2013-10-31 16:16:28,497 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56022, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9043489202376737003_1311, duration: 850967
2013-10-31 16:16:28,497 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9043489202376737003_1311 terminating
2013-10-31 16:16:28,497 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-9043489202376737003_1311 size 116
2013-10-31 16:16:28,498 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35985, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9043489202376737003_1311, duration: 1710889
2013-10-31 16:16:28,498 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9043489202376737003_1311 terminating
2013-10-31 16:16:28,501 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9043489202376737003_1311 size 116
2013-10-31 16:16:28,502 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken from client DFSClient_1457307213
2013-10-31 16:16:28,502 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken is closed by DFSClient_1457307213
2013-10-31 16:16:28,503 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9043489202376737003_1311 size 116
2013-10-31 16:16:28,510 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken
2013-10-31 16:16:28,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:16:28,515 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56024, bytes: 187, op: HDFS_READ, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2701757164713452030_1307, duration: 322793
2013-10-31 16:16:28,516 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0027 = 19. Number of splits = 5
2013-10-31 16:16:28,516 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,516 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,517 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,517 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,517 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,517 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,518 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,518 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,518 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,518 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,520 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0027 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:16:28,520 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0027 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:16:29,858 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5219485888681558172_1296 file build/test/data/dfs/data/data2/current/blk_-5219485888681558172 for deletion
2013-10-31 16:16:29,858 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1998638381933410712_1297 file build/test/data/dfs/data/data1/current/blk_-1998638381933410712 for deletion
2013-10-31 16:16:29,859 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5219485888681558172_1296 at file build/test/data/dfs/data/data2/current/blk_-5219485888681558172
2013-10-31 16:16:29,859 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1998638381933410712_1297 at file build/test/data/dfs/data/data1/current/blk_-1998638381933410712
2013-10-31 16:16:30,310 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_6563616459556469136_1305 to datanode(s) 127.0.0.1:38271
2013-10-31 16:16:30,310 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-3603487056913048693_1302
2013-10-31 16:16:30,311 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-3603487056913048693_1302
2013-10-31 16:16:30,321 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0027_m_000006_0' to tip task_20131031160444934_0027_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:30,326 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:16:30,327 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000006_0 which needs 1 slots
2013-10-31 16:16:30,327 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000006_0 which needs 1 slots
2013-10-31 16:16:30,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken	dst=null	perm=null
2013-10-31 16:16:30,332 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35989, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9043489202376737003_1311, duration: 315779
2013-10-31 16:16:30,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml	dst=null	perm=null
2013-10-31 16:16:30,337 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35922, bytes: 28975, op: HDFS_READ, cliID: DFSClient_1341455733, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_58242616522772820_1308, duration: 382032
2013-10-31 16:16:30,356 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:30,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar	dst=null	perm=null
2013-10-31 16:16:30,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56028, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1341455733, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6563616459556469136_1305, duration: 622899
2013-10-31 16:16:30,435 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0026_m_-851400586
2013-10-31 16:16:30,440 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26261 with signal TERM. Exit code 0
2013-10-31 16:16:30,440 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_-1178212220
2013-10-31 16:16:30,440 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_-1178212220 spawned.
2013-10-31 16:16:30,442 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000006_0/taskjvm.sh
2013-10-31 16:16:30,465 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0026_m_-851400586
2013-10-31 16:16:31,097 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:31,097 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:31,097 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:31,097 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_-851400586 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:31,744 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1178212220 given task: attempt_20131031160444934_0027_m_000006_0
2013-10-31 16:16:32,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:32,317 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0026
2013-10-31 16:16:32,317 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0026_m_000005_0 not found in cache
2013-10-31 16:16:32,318 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0026 for user-log deletion with retainTimeStamp:1383322592317
2013-10-31 16:16:32,318 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_r_-1130629699 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:32,324 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26552 with signal TERM. Exit code 0
2013-10-31 16:16:32,438 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0026
2013-10-31 16:16:32,439 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0026 for user-log deletion with retainTimeStamp:1383322592438
2013-10-31 16:16:32,492 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:32,492 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:32,492 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:32,492 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_r_-1130629699 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:32,515 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0026
2013-10-31 16:16:32,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0026 for user-log deletion with retainTimeStamp:1383322592515
2013-10-31 16:16:32,721 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_m_790658481 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:32,733 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26344 with signal TERM. Exit code 0
2013-10-31 16:16:32,858 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3603487056913048693_1302 file build/test/data/dfs/data/data1/current/blk_-3603487056913048693 for deletion
2013-10-31 16:16:32,859 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3603487056913048693_1302 at file build/test/data/dfs/data/data1/current/blk_-3603487056913048693
2013-10-31 16:16:32,955 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:32,955 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:32,955 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:32,956 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_790658481 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:33,069 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_6563616459556469136_1305 to 127.0.0.1:38271 
2013-10-31 16:16:33,070 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3603487056913048693_1302 file build/test/data/dfs/data/data8/current/blk_-3603487056913048693 for deletion
2013-10-31 16:16:33,070 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3603487056913048693_1302 at file build/test/data/dfs/data/data8/current/blk_-3603487056913048693
2013-10-31 16:16:33,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6563616459556469136_1305 src: /127.0.0.1:35996 dest: /127.0.0.1:38271
2013-10-31 16:16:33,071 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_6563616459556469136_1305 to /127.0.0.1:38271
2013-10-31 16:16:33,075 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6563616459556469136_1305 src: /127.0.0.1:35996 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:16:33,075 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6563616459556469136_1305 size 238055
2013-10-31 16:16:33,161 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_m_1344813911 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:33,162 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_m_1084653767 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:33,172 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26385 with signal TERM. Exit code 0
2013-10-31 16:16:33,172 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26384 with signal TERM. Exit code 0
2013-10-31 16:16:33,280 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_m_-1242438880 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:33,285 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26168 with signal TERM. Exit code 0
2013-10-31 16:16:33,311 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-3603487056913048693_1302
2013-10-31 16:16:33,391 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:33,391 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:33,391 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:33,392 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:33,391 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:33,392 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:33,393 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_1084653767 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:33,393 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_1344813911 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:33,455 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:33,456 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:33,456 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:33,456 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_-1242438880 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:16:33,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3603487056913048693_1302 file build/test/data/dfs/data/data4/current/blk_-3603487056913048693 for deletion
2013-10-31 16:16:33,459 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3603487056913048693_1302 at file build/test/data/dfs/data/data4/current/blk_-3603487056913048693
2013-10-31 16:16:35,181 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000006_0 0.0% setup
2013-10-31 16:16:35,184 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000006_0 is done.
2013-10-31 16:16:35,185 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000006_0  was -1
2013-10-31 16:16:35,185 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:36,331 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000006_0' has completed task_20131031160444934_0027_m_000006 successfully.
2013-10-31 16:16:36,334 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000000_0' to tip task_20131031160444934_0027_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:36,335 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000000
2013-10-31 16:16:36,335 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000001_0' to tip task_20131031160444934_0027_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:36,336 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000001
2013-10-31 16:16:36,338 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:16:36,339 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:16:36,339 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000000_0 which needs 1 slots
2013-10-31 16:16:36,339 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000000_0 which needs 1 slots
2013-10-31 16:16:36,340 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000001_0 which needs 1 slots
2013-10-31 16:16:36,340 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0027_m_000001_0 which needs 1 slots
2013-10-31 16:16:36,370 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_404846204
2013-10-31 16:16:36,371 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_404846204 spawned.
2013-10-31 16:16:36,372 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0027/attempt_20131031160444934_0027_m_000001_0. Attempting to reuse: jvm_20131031160444934_0027_m_-1178212220
2013-10-31 16:16:36,372 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000000_0/taskjvm.sh
2013-10-31 16:16:36,444 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000002_0' to tip task_20131031160444934_0027_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:36,445 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000002
2013-10-31 16:16:36,445 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000003_0' to tip task_20131031160444934_0027_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:36,446 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000003
2013-10-31 16:16:36,447 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:16:36,448 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:16:36,448 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000002_0 which needs 1 slots
2013-10-31 16:16:36,448 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000002_0 which needs 1 slots
2013-10-31 16:16:36,449 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000003_0 which needs 1 slots
2013-10-31 16:16:36,449 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0027_m_000003_0 which needs 1 slots
2013-10-31 16:16:36,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken	dst=null	perm=null
2013-10-31 16:16:36,457 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56036, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9043489202376737003_1311, duration: 278884
2013-10-31 16:16:36,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml	dst=null	perm=null
2013-10-31 16:16:36,467 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49035, bytes: 28975, op: HDFS_READ, cliID: DFSClient_-1922558963, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_58242616522772820_1308, duration: 362642
2013-10-31 16:16:36,489 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:36,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar	dst=null	perm=null
2013-10-31 16:16:36,502 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56039, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1922558963, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6563616459556469136_1305, duration: 597177
2013-10-31 16:16:36,522 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000004_0' to tip task_20131031160444934_0027_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:16:36,522 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000004
2013-10-31 16:16:36,523 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:16:36,523 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000004_0 which needs 1 slots
2013-10-31 16:16:36,523 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000004_0 which needs 1 slots
2013-10-31 16:16:36,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken	dst=null	perm=null
2013-10-31 16:16:36,526 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56040, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9043489202376737003_1311, duration: 184806
2013-10-31 16:16:36,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml	dst=null	perm=null
2013-10-31 16:16:36,531 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35937, bytes: 28975, op: HDFS_READ, cliID: DFSClient_-951188114, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_58242616522772820_1308, duration: 154505
2013-10-31 16:16:36,544 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:36,554 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_623587581
2013-10-31 16:16:36,555 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_623587581 spawned.
2013-10-31 16:16:36,556 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_-1289007788
2013-10-31 16:16:36,556 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_-1289007788 spawned.
2013-10-31 16:16:36,557 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000002_0/taskjvm.sh
2013-10-31 16:16:36,557 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000003_0/taskjvm.sh
2013-10-31 16:16:36,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar	dst=null	perm=null
2013-10-31 16:16:36,560 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36007, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-951188114, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6563616459556469136_1305, duration: 594154
2013-10-31 16:16:36,741 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_-1194820009
2013-10-31 16:16:36,741 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_-1194820009 spawned.
2013-10-31 16:16:36,742 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000004_0/taskjvm.sh
2013-10-31 16:16:36,748 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1178212220 given task: attempt_20131031160444934_0027_m_000001_0
2013-10-31 16:16:36,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split	dst=null	perm=null
2013-10-31 16:16:36,847 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49042, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6529624484255616460_1306, duration: 165641
2013-10-31 16:16:36,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:16:36,888 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36010, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 125003
2013-10-31 16:16:36,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:37,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:37,204 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_404846204 given task: attempt_20131031160444934_0027_m_000000_0
2013-10-31 16:16:37,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853	dst=null	perm=null
2013-10-31 16:16:37,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:37,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:37,276 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49045, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5924082644072865753_1303, duration: 160719
2013-10-31 16:16:37,296 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001. blk_2697455260120737558_1312
2013-10-31 16:16:37,318 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2697455260120737558_1312 src: /127.0.0.1:36013 dest: /127.0.0.1:38271
2013-10-31 16:16:37,319 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2697455260120737558_1312 src: /127.0.0.1:56050 dest: /127.0.0.1:41648
2013-10-31 16:16:37,320 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2697455260120737558_1312 src: /127.0.0.1:35946 dest: /127.0.0.1:50942
2013-10-31 16:16:37,323 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35946, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2697455260120737558_1312, duration: 1879546
2013-10-31 16:16:37,324 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2697455260120737558_1312 terminating
2013-10-31 16:16:37,324 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56050, dest: /127.0.0.1:41648, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2697455260120737558_1312, duration: 2112264
2013-10-31 16:16:37,324 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2697455260120737558_1312 terminating
2013-10-31 16:16:37,324 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36013, dest: /127.0.0.1:38271, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2697455260120737558_1312, duration: 2479135
2013-10-31 16:16:37,324 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2697455260120737558_1312 terminating
2013-10-31 16:16:37,326 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2697455260120737558_1312 size 14
2013-10-31 16:16:37,326 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0027_m_000001_0
2013-10-31 16:16:37,326 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0027_m_000001_0
2013-10-31 16:16:37,326 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2697455260120737558_1312 size 14
2013-10-31 16:16:37,328 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2697455260120737558_1312 size 14
2013-10-31 16:16:37,366 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:37,367 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000001_0 0.0% 
2013-10-31 16:16:37,678 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_623587581 given task: attempt_20131031160444934_0027_m_000002_0
2013-10-31 16:16:37,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split	dst=null	perm=null
2013-10-31 16:16:37,749 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36020, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6529624484255616460_1306, duration: 169770
2013-10-31 16:16:37,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:16:37,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:37,805 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1289007788 given task: attempt_20131031160444934_0027_m_000003_0
2013-10-31 16:16:37,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:37,818 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1194820009 given task: attempt_20131031160444934_0027_m_000004_0
2013-10-31 16:16:38,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853	dst=null	perm=null
2013-10-31 16:16:38,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:38,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:38,047 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35952, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5924082644072865753_1303, duration: 209402
2013-10-31 16:16:38,063 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49055, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 128529
2013-10-31 16:16:38,069 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000. blk_4396387988779245889_1313
2013-10-31 16:16:38,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4396387988779245889_1313 src: /127.0.0.1:49056 dest: /127.0.0.1:47311
2013-10-31 16:16:38,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4396387988779245889_1313 src: /127.0.0.1:56061 dest: /127.0.0.1:41648
2013-10-31 16:16:38,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4396387988779245889_1313 src: /127.0.0.1:35957 dest: /127.0.0.1:50942
2013-10-31 16:16:38,103 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35957, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4396387988779245889_1313, duration: 1487129
2013-10-31 16:16:38,104 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4396387988779245889_1313 terminating
2013-10-31 16:16:38,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56061, dest: /127.0.0.1:41648, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4396387988779245889_1313, duration: 1611947
2013-10-31 16:16:38,104 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4396387988779245889_1313 terminating
2013-10-31 16:16:38,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49056, dest: /127.0.0.1:47311, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4396387988779245889_1313, duration: 1979997
2013-10-31 16:16:38,104 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4396387988779245889_1313 terminating
2013-10-31 16:16:38,105 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4396387988779245889_1313 size 14
2013-10-31 16:16:38,105 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0027_m_000000_0
2013-10-31 16:16:38,105 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0027_m_000000_0
2013-10-31 16:16:38,105 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4396387988779245889_1313 size 14
2013-10-31 16:16:38,106 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4396387988779245889_1313 size 14
2013-10-31 16:16:38,164 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:38,165 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000000_0 0.0% 
2013-10-31 16:16:38,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split	dst=null	perm=null
2013-10-31 16:16:38,188 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56063, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6529624484255616460_1306, duration: 166673
2013-10-31 16:16:38,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:16:38,231 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36029, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 126710
2013-10-31 16:16:38,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:38,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split	dst=null	perm=null
2013-10-31 16:16:38,301 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36031, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6529624484255616460_1306, duration: 160875
2013-10-31 16:16:38,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split	dst=null	perm=null
2013-10-31 16:16:38,329 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36032, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6529624484255616460_1306, duration: 161203
2013-10-31 16:16:38,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:16:38,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:16:38,647 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49066, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 266324
2013-10-31 16:16:38,647 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36034, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 269742
2013-10-31 16:16:38,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:38,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:38,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:38,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:38,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:38,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853	dst=null	perm=null
2013-10-31 16:16:38,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853	dst=null	perm=null
2013-10-31 16:16:38,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853	dst=null	perm=null
2013-10-31 16:16:38,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:38,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:38,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:38,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:38,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:38,957 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49068, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5924082644072865753_1303, duration: 143505
2013-10-31 16:16:38,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000	dst=null	perm=null
2013-10-31 16:16:38,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35967, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5924082644072865753_1303, duration: 129290
2013-10-31 16:16:38,961 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36037, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5924082644072865753_1303, duration: 125114
2013-10-31 16:16:38,977 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003. blk_8510502824651321761_1316
2013-10-31 16:16:38,979 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004. blk_-5537475891041042573_1316
2013-10-31 16:16:38,981 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002. blk_7458281921813337393_1316
2013-10-31 16:16:39,000 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8510502824651321761_1316 src: /127.0.0.1:49071 dest: /127.0.0.1:47311
2013-10-31 16:16:39,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8510502824651321761_1316 src: /127.0.0.1:35972 dest: /127.0.0.1:50942
2013-10-31 16:16:39,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5537475891041042573_1316 src: /127.0.0.1:35970 dest: /127.0.0.1:50942
2013-10-31 16:16:39,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8510502824651321761_1316 src: /127.0.0.1:36042 dest: /127.0.0.1:38271
2013-10-31 16:16:39,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5537475891041042573_1316 src: /127.0.0.1:56079 dest: /127.0.0.1:41648
2013-10-31 16:16:39,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5537475891041042573_1316 src: /127.0.0.1:36044 dest: /127.0.0.1:38271
2013-10-31 16:16:39,004 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36042, dest: /127.0.0.1:38271, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8510502824651321761_1316, duration: 1023160
2013-10-31 16:16:39,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7458281921813337393_1316 src: /127.0.0.1:36040 dest: /127.0.0.1:38271
2013-10-31 16:16:39,007 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8510502824651321761_1316 size 14
2013-10-31 16:16:39,007 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8510502824651321761_1316 terminating
2013-10-31 16:16:39,007 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35972, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8510502824651321761_1316, duration: 4594011
2013-10-31 16:16:39,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36044, dest: /127.0.0.1:38271, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5537475891041042573_1316, duration: 213631
2013-10-31 16:16:39,008 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5537475891041042573_1316 size 14
2013-10-31 16:16:39,008 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8510502824651321761_1316 terminating
2013-10-31 16:16:39,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49071, dest: /127.0.0.1:47311, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8510502824651321761_1316, duration: 5678084
2013-10-31 16:16:39,008 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5537475891041042573_1316 terminating
2013-10-31 16:16:39,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7458281921813337393_1316 src: /127.0.0.1:35976 dest: /127.0.0.1:50942
2013-10-31 16:16:39,009 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8510502824651321761_1316 terminating
2013-10-31 16:16:39,009 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56079, dest: /127.0.0.1:41648, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5537475891041042573_1316, duration: 2133647
2013-10-31 16:16:39,011 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0027_m_000003_0
2013-10-31 16:16:39,011 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5537475891041042573_1316 terminating
2013-10-31 16:16:39,011 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0027_m_000003_0
2013-10-31 16:16:39,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7458281921813337393_1316 src: /127.0.0.1:56082 dest: /127.0.0.1:41648
2013-10-31 16:16:39,011 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35970, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5537475891041042573_1316, duration: 4196209
2013-10-31 16:16:39,011 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5537475891041042573_1316 size 14
2013-10-31 16:16:39,012 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5537475891041042573_1316 terminating
2013-10-31 16:16:39,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8510502824651321761_1316 size 14
2013-10-31 16:16:39,015 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0027_m_000004_0
2013-10-31 16:16:39,015 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0027_m_000004_0
2013-10-31 16:16:39,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56082, dest: /127.0.0.1:41648, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7458281921813337393_1316, duration: 1777793
2013-10-31 16:16:39,015 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8510502824651321761_1316 size 14
2013-10-31 16:16:39,016 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7458281921813337393_1316 terminating
2013-10-31 16:16:39,016 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5537475891041042573_1316 size 14
2013-10-31 16:16:39,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35976, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7458281921813337393_1316, duration: 978472
2013-10-31 16:16:39,016 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7458281921813337393_1316 terminating
2013-10-31 16:16:39,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36040, dest: /127.0.0.1:38271, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7458281921813337393_1316, duration: 1070706
2013-10-31 16:16:39,016 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7458281921813337393_1316 size 14
2013-10-31 16:16:39,017 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7458281921813337393_1316 terminating
2013-10-31 16:16:39,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7458281921813337393_1316 size 14
2013-10-31 16:16:39,017 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0027_m_000002_0
2013-10-31 16:16:39,018 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0027_m_000002_0
2013-10-31 16:16:39,020 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7458281921813337393_1316 size 14
2013-10-31 16:16:39,067 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:39,067 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000002_0 0.0% 
2013-10-31 16:16:39,071 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:39,071 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000003_0 0.0% 
2013-10-31 16:16:39,077 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:39,077 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000004_0 0.0% 
2013-10-31 16:16:39,343 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000000_0
2013-10-31 16:16:39,343 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000001_0
2013-10-31 16:16:39,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0	dst=null	perm=null
2013-10-31 16:16:39,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:39,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:39,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0	dst=null	perm=null
2013-10-31 16:16:39,453 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000002_0
2013-10-31 16:16:39,453 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000003_0
2013-10-31 16:16:39,527 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000004_0
2013-10-31 16:16:39,812 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:16:39,814 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000001_0 is done.
2013-10-31 16:16:39,814 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000001_0  was -1
2013-10-31 16:16:39,814 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:16:39,848 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:16:39,863 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,868 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,874 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,879 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,885 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,890 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,890 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:16:40,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0	dst=null	perm=null
2013-10-31 16:16:40,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:40,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0	dst=null	perm=null
2013-10-31 16:16:40,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:40,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0	dst=null	perm=null
2013-10-31 16:16:40,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:40,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:40,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:40,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:40,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0	dst=null	perm=null
2013-10-31 16:16:40,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0	dst=null	perm=null
2013-10-31 16:16:40,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:40,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0	dst=null	perm=null
2013-10-31 16:16:40,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0	dst=null	perm=null
2013-10-31 16:16:40,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:40,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0	dst=null	perm=null
2013-10-31 16:16:40,643 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:16:40,644 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000000_0 is done.
2013-10-31 16:16:40,645 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000000_0  was -1
2013-10-31 16:16:40,645 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:41,113 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:16:41,114 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000002_0 is done.
2013-10-31 16:16:41,115 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000002_0  was -1
2013-10-31 16:16:41,115 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:16:41,227 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:16:41,229 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000003_0 is done.
2013-10-31 16:16:41,229 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000003_0  was -1
2013-10-31 16:16:41,229 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:41,257 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:16:41,258 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000004_0 is done.
2013-10-31 16:16:41,258 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000004_0  was -1
2013-10-31 16:16:41,258 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:41,339 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0027_m_000006_0
2013-10-31 16:16:41,339 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0027_m_000006_0
2013-10-31 16:16:41,339 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000006_0 not found in cache
2013-10-31 16:16:42,347 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000000_0' has completed task_20131031160444934_0027_m_000000 successfully.
2013-10-31 16:16:42,349 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000001_0' has completed task_20131031160444934_0027_m_000001 successfully.
2013-10-31 16:16:42,457 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000002_0' has completed task_20131031160444934_0027_m_000002 successfully.
2013-10-31 16:16:42,459 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000003_0' has completed task_20131031160444934_0027_m_000003 successfully.
2013-10-31 16:16:42,531 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000004_0' has completed task_20131031160444934_0027_m_000004 successfully.
2013-10-31 16:16:42,533 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0027_m_000005_0' to tip task_20131031160444934_0027_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:16:42,536 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:16:42,536 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000005_0 which needs 1 slots
2013-10-31 16:16:42,537 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000005_0 which needs 1 slots
2013-10-31 16:16:42,569 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_-1344958877
2013-10-31 16:16:42,570 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_-1344958877 spawned.
2013-10-31 16:16:42,571 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000005_0/taskjvm.sh
2013-10-31 16:16:43,428 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1344958877 given task: attempt_20131031160444934_0027_m_000005_0
2013-10-31 16:16:43,931 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000005_0 0.0% 
2013-10-31 16:16:43,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary	dst=null	perm=null
2013-10-31 16:16:43,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:43,953 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS from client DFSClient_attempt_20131031160444934_0027_m_000005_0
2013-10-31 16:16:43,954 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0027_m_000005_0
2013-10-31 16:16:43,959 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6563616459556469136 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:43,959 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6563616459556469136 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:43,959 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6563616459556469136 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6563616459556469136 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6529624484255616460 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6529624484255616460 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6529624484255616460 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6529624484255616460 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2701757164713452030 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2701757164713452030 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2701757164713452030 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_58242616522772820 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_58242616522772820 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:43,960 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_58242616522772820 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:43,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027	dst=null	perm=null
2013-10-31 16:16:45,313 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_58242616522772820_1308 blk_6563616459556469136_1305 blk_-6529624484255616460_1306
2013-10-31 16:16:45,314 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_58242616522772820_1308 blk_6563616459556469136_1305 blk_-6529624484255616460_1306 blk_-2701757164713452030_1307
2013-10-31 16:16:45,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6529624484255616460_1306 file build/test/data/dfs/data/data4/current/blk_-6529624484255616460 for deletion
2013-10-31 16:16:45,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2701757164713452030_1307 file build/test/data/dfs/data/data3/current/blk_-2701757164713452030 for deletion
2013-10-31 16:16:45,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6529624484255616460_1306 at file build/test/data/dfs/data/data4/current/blk_-6529624484255616460
2013-10-31 16:16:45,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_58242616522772820_1308 file build/test/data/dfs/data/data4/current/blk_58242616522772820 for deletion
2013-10-31 16:16:45,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2701757164713452030_1307 at file build/test/data/dfs/data/data3/current/blk_-2701757164713452030
2013-10-31 16:16:45,464 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_58242616522772820_1308 at file build/test/data/dfs/data/data4/current/blk_58242616522772820
2013-10-31 16:16:45,464 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6563616459556469136_1305 file build/test/data/dfs/data/data3/current/blk_6563616459556469136 for deletion
2013-10-31 16:16:45,465 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6563616459556469136_1305 at file build/test/data/dfs/data/data3/current/blk_6563616459556469136
2013-10-31 16:16:46,866 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000005_0 0.0% cleanup
2013-10-31 16:16:46,867 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000005_0 is done.
2013-10-31 16:16:46,868 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000005_0  was -1
2013-10-31 16:16:46,868 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:48,074 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6529624484255616460_1306 file build/test/data/dfs/data/data8/current/blk_-6529624484255616460 for deletion
2013-10-31 16:16:48,074 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_58242616522772820_1308 file build/test/data/dfs/data/data7/current/blk_58242616522772820 for deletion
2013-10-31 16:16:48,074 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6529624484255616460_1306 at file build/test/data/dfs/data/data8/current/blk_-6529624484255616460
2013-10-31 16:16:48,074 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6563616459556469136_1305 file build/test/data/dfs/data/data7/current/blk_6563616459556469136 for deletion
2013-10-31 16:16:48,075 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_58242616522772820_1308 at file build/test/data/dfs/data/data7/current/blk_58242616522772820
2013-10-31 16:16:48,075 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6563616459556469136_1305 at file build/test/data/dfs/data/data7/current/blk_6563616459556469136
2013-10-31 16:16:48,314 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_58242616522772820_1308 blk_6563616459556469136_1305 blk_-6529624484255616460_1306 blk_-2701757164713452030_1307
2013-10-31 16:16:48,314 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_6563616459556469136_1305 blk_-6529624484255616460_1306 blk_-2701757164713452030_1307
2013-10-31 16:16:48,544 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000005_0' has completed task_20131031160444934_0027_m_000005 successfully.
2013-10-31 16:16:48,545 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0027 has completed successfully.
2013-10-31 16:16:48,546 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0027,submitTime=1383236188000,launchTime=1383236188520,firstMapTaskLaunchTime=1383236196334,firstJobSetupTaskLaunchTime=1383236190321,firstJobCleanupTaskLaunchTime=1383236202533,finishTime=1383236208545,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D198DEC2FB1E42BAA7C2368DEA5C9FEF/D1F0EC65F53C4984AE7BD7AC858FA9B2] lower*upper/(1/2) ...atform/joinfilteredbranch
2013-10-31 16:16:48,551 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984. blk_7293811695906113261_1317
2013-10-31 16:16:48,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7293811695906113261_1317 src: /127.0.0.1:35981 dest: /127.0.0.1:50942
2013-10-31 16:16:48,556 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7293811695906113261_1317 src: /127.0.0.1:49084 dest: /127.0.0.1:47311
2013-10-31 16:16:48,559 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7293811695906113261_1317 src: /127.0.0.1:36052 dest: /127.0.0.1:38271
2013-10-31 16:16:48,562 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36052, dest: /127.0.0.1:38271, bytes: 26353, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7293811695906113261_1317, duration: 194518
2013-10-31 16:16:48,562 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7293811695906113261_1317 terminating
2013-10-31 16:16:48,563 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49084, dest: /127.0.0.1:47311, bytes: 26353, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7293811695906113261_1317, duration: 1043784
2013-10-31 16:16:48,563 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7293811695906113261_1317 terminating
2013-10-31 16:16:48,563 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35981, dest: /127.0.0.1:50942, bytes: 26353, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7293811695906113261_1317, duration: 1969897
2013-10-31 16:16:48,564 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7293811695906113261_1317 terminating
2013-10-31 16:16:48,568 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7293811695906113261_1317 size 26353
2013-10-31 16:16:48,568 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984 from client DFSClient_-355221738
2013-10-31 16:16:48,569 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984 is closed by DFSClient_-355221738
2013-10-31 16:16:48,569 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7293811695906113261_1317 size 26353
2013-10-31 16:16:48,569 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7293811695906113261_1317 size 26353
2013-10-31 16:16:48,576 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:16:48,577 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000004_0'
2013-10-31 16:16:48,577 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000005_0'
2013-10-31 16:16:48,579 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9043489202376737003 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:48,579 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9043489202376737003 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:48,579 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9043489202376737003 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:48,582 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0027_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:16:48,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027	dst=null	perm=null
2013-10-31 16:16:48,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6262429360302313689 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:48,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6262429360302313689 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:48,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6262429360302313689 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:48,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7019503529854675644 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:48,586 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7019503529854675644 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:48,586 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7019503529854675644 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:48,586 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5924082644072865753 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:48,586 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5924082644072865753 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:48,587 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5924082644072865753 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:48,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853	dst=null	perm=null
2013-10-31 16:16:48,594 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary
2013-10-31 16:16:48,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2013-10-31 16:16:48,614 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:16:48,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2013-10-31 16:16:48,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2013-10-31 16:16:48,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2013-10-31 16:16:48,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2013-10-31 16:16:48,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2013-10-31 16:16:48,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2013-10-31 16:16:48,624 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49087, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4396387988779245889_1313, duration: 273422
2013-10-31 16:16:48,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2013-10-31 16:16:48,627 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36055, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2697455260120737558_1312, duration: 255250
2013-10-31 16:16:48,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2013-10-31 16:16:48,630 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56092, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7458281921813337393_1316, duration: 251528
2013-10-31 16:16:48,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2013-10-31 16:16:48,633 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49090, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8510502824651321761_1316, duration: 253009
2013-10-31 16:16:48,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2013-10-31 16:16:48,636 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35989, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5537475891041042573_1316, duration: 260346
2013-10-31 16:16:48,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2013-10-31 16:16:48,654 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:16:48,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2013-10-31 16:16:48,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2013-10-31 16:16:48,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2013-10-31 16:16:48,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2013-10-31 16:16:48,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2013-10-31 16:16:48,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2013-10-31 16:16:48,663 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49092, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4396387988779245889_1313, duration: 261196
2013-10-31 16:16:48,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2013-10-31 16:16:48,666 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56096, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2697455260120737558_1312, duration: 255043
2013-10-31 16:16:48,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2013-10-31 16:16:48,669 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35992, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7458281921813337393_1316, duration: 249213
2013-10-31 16:16:48,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2013-10-31 16:16:48,672 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35993, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8510502824651321761_1316, duration: 249344
2013-10-31 16:16:48,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2013-10-31 16:16:48,675 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36063, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5537475891041042573_1316, duration: 253333
2013-10-31 16:16:48,676 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinfilteredbranch
2013-10-31 16:16:48,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2013-10-31 16:16:48,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2013-10-31 16:16:48,684 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35995, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4396387988779245889_1313, duration: 255622
2013-10-31 16:16:48,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2013-10-31 16:16:48,688 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56101, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2697455260120737558_1312, duration: 252093
2013-10-31 16:16:48,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2013-10-31 16:16:48,692 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56102, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7458281921813337393_1316, duration: 294319
2013-10-31 16:16:48,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2013-10-31 16:16:48,697 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35998, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8510502824651321761_1316, duration: 320017
2013-10-31 16:16:48,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2013-10-31 16:16:48,701 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36068, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5537475891041042573_1316, duration: 256109
2013-10-31 16:16:48,722 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:16:48,723 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:16:48,745 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] starting
2013-10-31 16:16:48,746 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:16:48,746 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:16:48,746 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:16:48,747 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin"]
2013-10-31 16:16:48,747 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  parallel execution is enabled: true
2013-10-31 16:16:48,747 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  starting jobs: 3
2013-10-31 16:16:48,747 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2]  allocating threads: 3
2013-10-31 16:16:48,748 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] starting step: (3/3)
2013-10-31 16:16:48,752 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:16:48,753 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:16:48,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:48,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:16:48,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:48,775 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar. blk_-8815791525567125083_1318
2013-10-31 16:16:48,776 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8815791525567125083_1318 src: /127.0.0.1:49102 dest: /127.0.0.1:47311
2013-10-31 16:16:48,778 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8815791525567125083_1318 src: /127.0.0.1:36001 dest: /127.0.0.1:50942
2013-10-31 16:16:48,780 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8815791525567125083_1318 src: /127.0.0.1:56107 dest: /127.0.0.1:41648
2013-10-31 16:16:48,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56107, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8815791525567125083_1318, duration: 3954969
2013-10-31 16:16:48,787 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8815791525567125083_1318 terminating
2013-10-31 16:16:48,788 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36001, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8815791525567125083_1318, duration: 5135924
2013-10-31 16:16:48,788 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8815791525567125083_1318 terminating
2013-10-31 16:16:48,789 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49102, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8815791525567125083_1318, duration: 5693865
2013-10-31 16:16:48,789 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8815791525567125083_1318 size 238055
2013-10-31 16:16:48,789 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8815791525567125083_1318 terminating
2013-10-31 16:16:48,790 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8815791525567125083_1318 size 238055
2013-10-31 16:16:48,791 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8815791525567125083_1318 size 238055
2013-10-31 16:16:48,791 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar from client DFSClient_1457307213
2013-10-31 16:16:48,792 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar is closed by DFSClient_1457307213
2013-10-31 16:16:48,798 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar. New replication is 10
2013-10-31 16:16:48,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar	dst=null	perm=null
2013-10-31 16:16:48,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:48,811 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:16:48,815 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:16:48,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:16:48,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:48,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:48,830 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split. New replication is 10
2013-10-31 16:16:48,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split	dst=null	perm=null
2013-10-31 16:16:48,838 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split. blk_-8399440944438708311_1319
2013-10-31 16:16:48,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8399440944438708311_1319 src: /127.0.0.1:36072 dest: /127.0.0.1:38271
2013-10-31 16:16:48,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8399440944438708311_1319 src: /127.0.0.1:56109 dest: /127.0.0.1:41648
2013-10-31 16:16:48,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8399440944438708311_1319 src: /127.0.0.1:49107 dest: /127.0.0.1:47311
2013-10-31 16:16:48,844 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8399440944438708311_1319 src: /127.0.0.1:36006 dest: /127.0.0.1:50942
2013-10-31 16:16:48,847 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36006, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8399440944438708311_1319, duration: 119986
2013-10-31 16:16:48,848 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8399440944438708311_1319 terminating
2013-10-31 16:16:48,848 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49107, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8399440944438708311_1319, duration: 961589
2013-10-31 16:16:48,849 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8399440944438708311_1319 terminating
2013-10-31 16:16:48,849 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56109, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8399440944438708311_1319, duration: 1830387
2013-10-31 16:16:48,849 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8399440944438708311_1319 terminating
2013-10-31 16:16:48,850 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36072, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8399440944438708311_1319, duration: 2677710
2013-10-31 16:16:48,850 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8399440944438708311_1319 size 1732
2013-10-31 16:16:48,850 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-8399440944438708311_1319 terminating
2013-10-31 16:16:48,852 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8399440944438708311_1319 size 1732
2013-10-31 16:16:48,852 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split from client DFSClient_1457307213
2013-10-31 16:16:48,853 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split is closed by DFSClient_1457307213
2013-10-31 16:16:48,853 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8399440944438708311_1319 size 1732
2013-10-31 16:16:48,854 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8399440944438708311_1319 size 1732
2013-10-31 16:16:49,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6529624484255616460_1306 file build/test/data/dfs/data/data5/current/blk_-6529624484255616460 for deletion
2013-10-31 16:16:49,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2701757164713452030_1307 file build/test/data/dfs/data/data6/current/blk_-2701757164713452030 for deletion
2013-10-31 16:16:49,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6529624484255616460_1306 at file build/test/data/dfs/data/data5/current/blk_-6529624484255616460
2013-10-31 16:16:49,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_58242616522772820_1308 file build/test/data/dfs/data/data5/current/blk_58242616522772820 for deletion
2013-10-31 16:16:49,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2701757164713452030_1307 at file build/test/data/dfs/data/data6/current/blk_-2701757164713452030
2013-10-31 16:16:49,080 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_58242616522772820_1308 at file build/test/data/dfs/data/data5/current/blk_58242616522772820
2013-10-31 16:16:49,080 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6563616459556469136_1305 file build/test/data/dfs/data/data6/current/blk_6563616459556469136 for deletion
2013-10-31 16:16:49,081 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6563616459556469136_1305 at file build/test/data/dfs/data/data6/current/blk_6563616459556469136
2013-10-31 16:16:49,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,750 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo. blk_-7961768246826946218_1320
2013-10-31 16:16:49,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7961768246826946218_1320 src: /127.0.0.1:56112 dest: /127.0.0.1:41648
2013-10-31 16:16:49,753 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7961768246826946218_1320 src: /127.0.0.1:36008 dest: /127.0.0.1:50942
2013-10-31 16:16:49,755 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7961768246826946218_1320 src: /127.0.0.1:36078 dest: /127.0.0.1:38271
2013-10-31 16:16:49,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36078, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7961768246826946218_1320, duration: 72137
2013-10-31 16:16:49,758 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7961768246826946218_1320 terminating
2013-10-31 16:16:49,759 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36008, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7961768246826946218_1320, duration: 841404
2013-10-31 16:16:49,759 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7961768246826946218_1320 size 183
2013-10-31 16:16:49,759 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7961768246826946218_1320 terminating
2013-10-31 16:16:49,760 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56112, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7961768246826946218_1320, duration: 2111895
2013-10-31 16:16:49,761 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7961768246826946218_1320 terminating
2013-10-31 16:16:49,764 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7961768246826946218_1320 size 183
2013-10-31 16:16:49,764 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:16:49,764 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:16:49,765 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7961768246826946218_1320 size 183
2013-10-31 16:16:49,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,795 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml. blk_1002969834028224173_1321
2013-10-31 16:16:49,796 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1002969834028224173_1321 src: /127.0.0.1:36079 dest: /127.0.0.1:38271
2013-10-31 16:16:49,798 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1002969834028224173_1321 src: /127.0.0.1:36011 dest: /127.0.0.1:50942
2013-10-31 16:16:49,799 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1002969834028224173_1321 src: /127.0.0.1:49114 dest: /127.0.0.1:47311
2013-10-31 16:16:49,802 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49114, dest: /127.0.0.1:47311, bytes: 27428, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1002969834028224173_1321, duration: 281671
2013-10-31 16:16:49,803 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1002969834028224173_1321 terminating
2013-10-31 16:16:49,803 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36011, dest: /127.0.0.1:50942, bytes: 27428, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1002969834028224173_1321, duration: 1224445
2013-10-31 16:16:49,804 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1002969834028224173_1321 terminating
2013-10-31 16:16:49,804 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1002969834028224173_1321 size 27428
2013-10-31 16:16:49,804 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36079, dest: /127.0.0.1:38271, bytes: 27428, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1002969834028224173_1321, duration: 2104855
2013-10-31 16:16:49,805 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1002969834028224173_1321 terminating
2013-10-31 16:16:49,807 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml from client DFSClient_1457307213
2013-10-31 16:16:49,808 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml is closed by DFSClient_1457307213
2013-10-31 16:16:49,808 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1002969834028224173_1321 size 27428
2013-10-31 16:16:49,809 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1002969834028224173_1321 size 27428
2013-10-31 16:16:49,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml	dst=null	perm=null
2013-10-31 16:16:49,825 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36083, bytes: 27644, op: HDFS_READ, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1002969834028224173_1321, duration: 397888
2013-10-31 16:16:49,843 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0028: nMaps=5 nReduces=0 max=-1
2013-10-31 16:16:49,843 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0028 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:16:49,843 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0028	RESULT=SUCCESS
2013-10-31 16:16:49,843 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0028
2013-10-31 16:16:49,843 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0028
2013-10-31 16:16:49,844 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] submitted hadoop job: job_20131031160444934_0028
2013-10-31 16:16:49,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,874 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_conf.xml. blk_5935025676836584846_1323
2013-10-31 16:16:49,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5935025676836584846_1323 src: /127.0.0.1:36015 dest: /127.0.0.1:50942
2013-10-31 16:16:49,877 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5935025676836584846_1323 src: /127.0.0.1:56121 dest: /127.0.0.1:41648
2013-10-31 16:16:49,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5935025676836584846_1323 src: /127.0.0.1:49119 dest: /127.0.0.1:47311
2013-10-31 16:16:49,883 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49119, dest: /127.0.0.1:47311, bytes: 27493, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5935025676836584846_1323, duration: 1038512
2013-10-31 16:16:49,883 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5935025676836584846_1323 terminating
2013-10-31 16:16:49,884 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56121, dest: /127.0.0.1:41648, bytes: 27493, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5935025676836584846_1323, duration: 1523641
2013-10-31 16:16:49,884 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5935025676836584846_1323 terminating
2013-10-31 16:16:49,884 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5935025676836584846_1323 size 27493
2013-10-31 16:16:49,885 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36015, dest: /127.0.0.1:50942, bytes: 27493, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5935025676836584846_1323, duration: 2752793
2013-10-31 16:16:49,885 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5935025676836584846_1323 terminating
2013-10-31 16:16:49,890 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5935025676836584846_1323 size 27493
2013-10-31 16:16:49,890 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_conf.xml from client DFSClient_-1085102077
2013-10-31 16:16:49,891 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_conf.xml is closed by DFSClient_-1085102077
2013-10-31 16:16:49,891 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5935025676836584846_1323 size 27493
2013-10-31 16:16:49,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,904 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken. blk_-3308714215337688669_1324
2013-10-31 16:16:49,905 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3308714215337688669_1324 src: /127.0.0.1:36018 dest: /127.0.0.1:50942
2013-10-31 16:16:49,907 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3308714215337688669_1324 src: /127.0.0.1:56124 dest: /127.0.0.1:41648
2013-10-31 16:16:49,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3308714215337688669_1324 src: /127.0.0.1:36089 dest: /127.0.0.1:38271
2013-10-31 16:16:49,911 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36089, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3308714215337688669_1324, duration: 66537
2013-10-31 16:16:49,912 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3308714215337688669_1324 terminating
2013-10-31 16:16:49,912 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56124, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3308714215337688669_1324, duration: 831756
2013-10-31 16:16:49,912 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3308714215337688669_1324 terminating
2013-10-31 16:16:49,913 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3308714215337688669_1324 size 116
2013-10-31 16:16:49,913 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36018, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3308714215337688669_1324, duration: 1725198
2013-10-31 16:16:49,914 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3308714215337688669_1324 terminating
2013-10-31 16:16:49,916 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3308714215337688669_1324 size 116
2013-10-31 16:16:49,916 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken from client DFSClient_1457307213
2013-10-31 16:16:49,917 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken is closed by DFSClient_1457307213
2013-10-31 16:16:49,917 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3308714215337688669_1324 size 116
2013-10-31 16:16:49,922 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken
2013-10-31 16:16:49,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:16:49,926 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36021, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7961768246826946218_1320, duration: 275335
2013-10-31 16:16:49,927 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0028 = 19. Number of splits = 5
2013-10-31 16:16:49,928 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,928 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,928 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,928 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,929 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,929 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,929 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,929 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,930 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,930 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,930 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,930 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,931 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,931 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,931 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,931 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0028 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:16:49,932 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0028 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:16:50,865 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6529624484255616460_1306 file build/test/data/dfs/data/data2/current/blk_-6529624484255616460 for deletion
2013-10-31 16:16:50,865 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2701757164713452030_1307 file build/test/data/dfs/data/data1/current/blk_-2701757164713452030 for deletion
2013-10-31 16:16:50,865 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6529624484255616460_1306 at file build/test/data/dfs/data/data2/current/blk_-6529624484255616460
2013-10-31 16:16:50,866 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2701757164713452030_1307 at file build/test/data/dfs/data/data1/current/blk_-2701757164713452030
2013-10-31 16:16:50,866 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6563616459556469136_1305 file build/test/data/dfs/data/data2/current/blk_6563616459556469136 for deletion
2013-10-31 16:16:50,867 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6563616459556469136_1305 at file build/test/data/dfs/data/data2/current/blk_6563616459556469136
2013-10-31 16:16:51,315 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-8815791525567125083_1318 to datanode(s) 127.0.0.1:38271
2013-10-31 16:16:51,316 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-7019503529854675644_1301 blk_-5924082644072865753_1303 blk_-9043489202376737003_1311 blk_-6262429360302313689_1304
2013-10-31 16:16:51,316 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-7019503529854675644_1301 blk_-5924082644072865753_1303 blk_-6262429360302313689_1304
2013-10-31 16:16:51,362 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0028_m_000006_0' to tip task_20131031160444934_0028_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:51,369 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000000_0'
2013-10-31 16:16:51,369 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000001_0'
2013-10-31 16:16:51,369 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000006_0'
2013-10-31 16:16:51,371 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:16:51,371 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000006_0 which needs 1 slots
2013-10-31 16:16:51,371 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000006_0 which needs 1 slots
2013-10-31 16:16:51,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken	dst=null	perm=null
2013-10-31 16:16:51,380 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36022, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3308714215337688669_1324, duration: 291948
2013-10-31 16:16:51,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml	dst=null	perm=null
2013-10-31 16:16:51,390 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36093, bytes: 27644, op: HDFS_READ, cliID: DFSClient_-1955750342, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1002969834028224173_1321, duration: 417875
2013-10-31 16:16:51,421 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:51,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar	dst=null	perm=null
2013-10-31 16:16:51,453 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36025, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1955750342, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8815791525567125083_1318, duration: 1236338
2013-10-31 16:16:51,465 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-8815791525567125083_1318 to 127.0.0.1:38271 
2013-10-31 16:16:51,465 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7019503529854675644_1301 file build/test/data/dfs/data/data3/current/blk_-7019503529854675644 for deletion
2013-10-31 16:16:51,466 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6262429360302313689_1304 file build/test/data/dfs/data/data4/current/blk_-6262429360302313689 for deletion
2013-10-31 16:16:51,466 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7019503529854675644_1301 at file build/test/data/dfs/data/data3/current/blk_-7019503529854675644
2013-10-31 16:16:51,466 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5924082644072865753_1303 file build/test/data/dfs/data/data3/current/blk_-5924082644072865753 for deletion
2013-10-31 16:16:51,466 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6262429360302313689_1304 at file build/test/data/dfs/data/data4/current/blk_-6262429360302313689
2013-10-31 16:16:51,467 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5924082644072865753_1303 at file build/test/data/dfs/data/data3/current/blk_-5924082644072865753
2013-10-31 16:16:51,467 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8815791525567125083_1318 src: /127.0.0.1:36095 dest: /127.0.0.1:38271
2013-10-31 16:16:51,467 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-8815791525567125083_1318 to /127.0.0.1:38271
2013-10-31 16:16:51,470 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000002_0'
2013-10-31 16:16:51,470 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000003_0'
2013-10-31 16:16:51,470 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8815791525567125083_1318 src: /127.0.0.1:36095 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:16:51,473 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8815791525567125083_1318 size 238055
2013-10-31 16:16:51,541 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0027
2013-10-31 16:16:51,541 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0027 being deleted.
2013-10-31 16:16:51,563 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0027_m_404846204
2013-10-31 16:16:51,570 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26910 with signal TERM. Exit code 0
2013-10-31 16:16:51,570 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_-248337255
2013-10-31 16:16:51,571 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_-248337255 spawned.
2013-10-31 16:16:51,574 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000006_0/taskjvm.sh
2013-10-31 16:16:51,660 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:51,660 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:51,660 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:51,660 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_404846204 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:53,028 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_-248337255 given task: attempt_20131031160444934_0028_m_000006_0
2013-10-31 16:16:53,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:53,579 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0027
2013-10-31 16:16:53,579 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000005_0 not found in cache
2013-10-31 16:16:53,579 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000004_0 not found in cache
2013-10-31 16:16:53,580 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0027 for user-log deletion with retainTimeStamp:1383322613580
2013-10-31 16:16:53,808 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_-1194820009 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:53,818 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27027 with signal TERM. Exit code 0
2013-10-31 16:16:53,865 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9043489202376737003_1311 file build/test/data/dfs/data/data1/current/blk_-9043489202376737003 for deletion
2013-10-31 16:16:53,866 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7019503529854675644_1301 file build/test/data/dfs/data/data2/current/blk_-7019503529854675644 for deletion
2013-10-31 16:16:53,866 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6262429360302313689_1304 file build/test/data/dfs/data/data1/current/blk_-6262429360302313689 for deletion
2013-10-31 16:16:53,866 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9043489202376737003_1311 at file build/test/data/dfs/data/data1/current/blk_-9043489202376737003
2013-10-31 16:16:53,866 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7019503529854675644_1301 at file build/test/data/dfs/data/data2/current/blk_-7019503529854675644
2013-10-31 16:16:53,866 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6262429360302313689_1304 at file build/test/data/dfs/data/data1/current/blk_-6262429360302313689
2013-10-31 16:16:53,866 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5924082644072865753_1303 file build/test/data/dfs/data/data2/current/blk_-5924082644072865753 for deletion
2013-10-31 16:16:53,867 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5924082644072865753_1303 at file build/test/data/dfs/data/data2/current/blk_-5924082644072865753
2013-10-31 16:16:54,021 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:54,021 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:54,022 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:54,022 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_-1194820009 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:54,317 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-7019503529854675644_1301 blk_-9043489202376737003_1311
2013-10-31 16:16:54,317 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-5924082644072865753_1303 blk_-9043489202376737003_1311 blk_-6262429360302313689_1304
2013-10-31 16:16:54,941 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_-1344958877 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:54,951 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27254 with signal TERM. Exit code 0
2013-10-31 16:16:55,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9043489202376737003_1311 file build/test/data/dfs/data/data5/current/blk_-9043489202376737003 for deletion
2013-10-31 16:16:55,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7019503529854675644_1301 file build/test/data/dfs/data/data6/current/blk_-7019503529854675644 for deletion
2013-10-31 16:16:55,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9043489202376737003_1311 at file build/test/data/dfs/data/data5/current/blk_-9043489202376737003
2013-10-31 16:16:55,080 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7019503529854675644_1301 at file build/test/data/dfs/data/data6/current/blk_-7019503529854675644
2013-10-31 16:16:55,127 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:55,127 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:55,127 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:55,127 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_-1344958877 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:56,371 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0027
2013-10-31 16:16:56,372 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000000_0 not found in cache
2013-10-31 16:16:56,372 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000001_0 not found in cache
2013-10-31 16:16:56,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0027 for user-log deletion with retainTimeStamp:1383322616373
2013-10-31 16:16:56,456 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000006_0 0.0% setup
2013-10-31 16:16:56,459 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000006_0 is done.
2013-10-31 16:16:56,459 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000006_0  was -1
2013-10-31 16:16:56,460 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:56,471 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0027
2013-10-31 16:16:56,471 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000002_0 not found in cache
2013-10-31 16:16:56,471 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000003_0 not found in cache
2013-10-31 16:16:56,472 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0027 for user-log deletion with retainTimeStamp:1383322616472
2013-10-31 16:16:56,694 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_623587581 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:56,704 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26991 with signal TERM. Exit code 0
2013-10-31 16:16:56,802 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_-1289007788 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:56,813 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27026 with signal TERM. Exit code 0
2013-10-31 16:16:56,863 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_-1178212220 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:56,867 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26758 with signal TERM. Exit code 0
2013-10-31 16:16:56,883 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:56,883 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:56,883 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:56,883 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_623587581 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:57,021 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:57,021 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:57,021 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:57,021 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_-1289007788 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:57,040 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:57,040 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:57,040 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:16:57,041 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_-1178212220 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:16:57,076 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9043489202376737003_1311 file build/test/data/dfs/data/data7/current/blk_-9043489202376737003 for deletion
2013-10-31 16:16:57,077 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6262429360302313689_1304 file build/test/data/dfs/data/data8/current/blk_-6262429360302313689 for deletion
2013-10-31 16:16:57,077 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9043489202376737003_1311 at file build/test/data/dfs/data/data7/current/blk_-9043489202376737003
2013-10-31 16:16:57,077 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6262429360302313689_1304 at file build/test/data/dfs/data/data8/current/blk_-6262429360302313689
2013-10-31 16:16:57,077 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5924082644072865753_1303 file build/test/data/dfs/data/data7/current/blk_-5924082644072865753 for deletion
2013-10-31 16:16:57,078 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5924082644072865753_1303 at file build/test/data/dfs/data/data7/current/blk_-5924082644072865753
2013-10-31 16:16:57,378 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000006_0' has completed task_20131031160444934_0028_m_000006 successfully.
2013-10-31 16:16:57,382 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000000_0' to tip task_20131031160444934_0028_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:57,384 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000000
2013-10-31 16:16:57,384 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000001_0' to tip task_20131031160444934_0028_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:57,385 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000001
2013-10-31 16:16:57,387 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:16:57,387 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:16:57,388 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000000_0 which needs 1 slots
2013-10-31 16:16:57,388 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000000_0 which needs 1 slots
2013-10-31 16:16:57,388 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000001_0 which needs 1 slots
2013-10-31 16:16:57,389 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0028_m_000001_0 which needs 1 slots
2013-10-31 16:16:57,426 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_1938196879
2013-10-31 16:16:57,427 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_1938196879 spawned.
2013-10-31 16:16:57,428 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0028/attempt_20131031160444934_0028_m_000001_0. Attempting to reuse: jvm_20131031160444934_0028_m_-248337255
2013-10-31 16:16:57,428 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000000_0/taskjvm.sh
2013-10-31 16:16:57,478 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000002_0' to tip task_20131031160444934_0028_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:57,478 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000002
2013-10-31 16:16:57,479 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000003_0' to tip task_20131031160444934_0028_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:57,501 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000003
2013-10-31 16:16:57,503 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:16:57,504 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:16:57,504 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000002_0 which needs 1 slots
2013-10-31 16:16:57,504 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000002_0 which needs 1 slots
2013-10-31 16:16:57,505 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000003_0 which needs 1 slots
2013-10-31 16:16:57,505 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0028_m_000003_0 which needs 1 slots
2013-10-31 16:16:57,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken	dst=null	perm=null
2013-10-31 16:16:57,512 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_-248337255 given task: attempt_20131031160444934_0028_m_000001_0
2013-10-31 16:16:57,514 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36099, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3308714215337688669_1324, duration: 292012
2013-10-31 16:16:57,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml	dst=null	perm=null
2013-10-31 16:16:57,525 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36032, bytes: 27644, op: HDFS_READ, cliID: DFSClient_-265396891, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1002969834028224173_1321, duration: 448048
2013-10-31 16:16:57,546 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000004_0' to tip task_20131031160444934_0028_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:16:57,546 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000004
2013-10-31 16:16:57,549 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:16:57,549 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000004_0 which needs 1 slots
2013-10-31 16:16:57,549 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000004_0 which needs 1 slots
2013-10-31 16:16:57,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken	dst=null	perm=null
2013-10-31 16:16:57,554 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56138, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3308714215337688669_1324, duration: 141720
2013-10-31 16:16:57,555 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:57,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml	dst=null	perm=null
2013-10-31 16:16:57,559 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36104, bytes: 27644, op: HDFS_READ, cliID: DFSClient_632657430, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1002969834028224173_1321, duration: 163419
2013-10-31 16:16:57,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar	dst=null	perm=null
2013-10-31 16:16:57,584 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:57,586 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36105, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-265396891, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8815791525567125083_1318, duration: 608894
2013-10-31 16:16:57,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar	dst=null	perm=null
2013-10-31 16:16:57,598 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36038, bytes: 239915, op: HDFS_READ, cliID: DFSClient_632657430, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8815791525567125083_1318, duration: 596288
2013-10-31 16:16:57,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split	dst=null	perm=null
2013-10-31 16:16:57,639 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36039, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8399440944438708311_1319, duration: 542643
2013-10-31 16:16:57,641 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_1931396390
2013-10-31 16:16:57,642 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_1931396390 spawned.
2013-10-31 16:16:57,643 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_-887656516
2013-10-31 16:16:57,643 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_-887656516 spawned.
2013-10-31 16:16:57,644 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000003_0/taskjvm.sh
2013-10-31 16:16:57,644 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000002_0/taskjvm.sh
2013-10-31 16:16:57,654 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_594753817
2013-10-31 16:16:57,655 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_594753817 spawned.
2013-10-31 16:16:57,656 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000004_0/taskjvm.sh
2013-10-31 16:16:58,322 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_1938196879 given task: attempt_20131031160444934_0028_m_000000_0
2013-10-31 16:16:59,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:00,264 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56146, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 288781
2013-10-31 16:17:00,282 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1730 Total time for transactions(ms): 37Number of transactions batched in Syncs: 183 Number of syncs: 1240 SyncTimes(ms): 52133 12336 
2013-10-31 16:17:00,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:00,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:00,623 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001. blk_4468907177856788027_1325
2013-10-31 16:17:00,642 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4468907177856788027_1325 src: /127.0.0.1:56148 dest: /127.0.0.1:41648
2013-10-31 16:17:00,643 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4468907177856788027_1325 src: /127.0.0.1:36113 dest: /127.0.0.1:38271
2013-10-31 16:17:00,644 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4468907177856788027_1325 src: /127.0.0.1:49147 dest: /127.0.0.1:47311
2013-10-31 16:17:00,646 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49147, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4468907177856788027_1325, duration: 1433167
2013-10-31 16:17:00,646 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4468907177856788027_1325 terminating
2013-10-31 16:17:00,647 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36113, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4468907177856788027_1325, duration: 1784095
2013-10-31 16:17:00,647 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4468907177856788027_1325 terminating
2013-10-31 16:17:00,647 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56148, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4468907177856788027_1325, duration: 2279343
2013-10-31 16:17:00,647 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4468907177856788027_1325 terminating
2013-10-31 16:17:00,650 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4468907177856788027_1325 size 92
2013-10-31 16:17:00,651 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4468907177856788027_1325 size 92
2013-10-31 16:17:00,651 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4468907177856788027_1325 size 92
2013-10-31 16:17:00,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split	dst=null	perm=null
2013-10-31 16:17:00,697 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36115, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8399440944438708311_1319, duration: 158602
2013-10-31 16:17:00,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:00,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:00,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:00,936 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36048, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 148177
2013-10-31 16:17:00,941 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000. blk_715915181680467880_1326
2013-10-31 16:17:00,974 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_715915181680467880_1326 src: /127.0.0.1:36049 dest: /127.0.0.1:50942
2013-10-31 16:17:00,975 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_715915181680467880_1326 src: /127.0.0.1:36119 dest: /127.0.0.1:38271
2013-10-31 16:17:00,976 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_715915181680467880_1326 src: /127.0.0.1:49153 dest: /127.0.0.1:47311
2013-10-31 16:17:00,978 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49153, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_715915181680467880_1326, duration: 1164592
2013-10-31 16:17:00,979 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_715915181680467880_1326 terminating
2013-10-31 16:17:00,979 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36119, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_715915181680467880_1326, duration: 1570349
2013-10-31 16:17:00,979 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_715915181680467880_1326 terminating
2013-10-31 16:17:00,979 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36049, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_715915181680467880_1326, duration: 1963875
2013-10-31 16:17:00,979 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_715915181680467880_1326 terminating
2013-10-31 16:17:00,981 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_715915181680467880_1326 size 92
2013-10-31 16:17:00,981 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_715915181680467880_1326 size 92
2013-10-31 16:17:00,982 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_715915181680467880_1326 size 92
2013-10-31 16:17:01,050 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0028_m_000001_0
2013-10-31 16:17:01,050 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0028_m_000001_0
2013-10-31 16:17:01,100 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:01,101 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000001_0 0.0% 
2013-10-31 16:17:01,197 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_594753817 given task: attempt_20131031160444934_0028_m_000004_0
2013-10-31 16:17:01,213 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_1931396390 given task: attempt_20131031160444934_0028_m_000003_0
2013-10-31 16:17:01,229 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_-887656516 given task: attempt_20131031160444934_0028_m_000002_0
2013-10-31 16:17:01,381 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0028_m_000000_0
2013-10-31 16:17:01,382 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0028_m_000000_0
2013-10-31 16:17:02,388 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0028_m_000006_0
2013-10-31 16:17:02,388 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0028_m_000006_0
2013-10-31 16:17:02,388 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000006_0 not found in cache
2013-10-31 16:17:03,390 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000001_0
2013-10-31 16:17:03,635 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:04,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0	dst=null	perm=null
2013-10-31 16:17:04,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:04,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:04,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0	dst=null	perm=null
2013-10-31 16:17:04,328 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:04,328 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000000_0 0.0% 
2013-10-31 16:17:04,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split	dst=null	perm=null
2013-10-31 16:17:04,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split	dst=null	perm=null
2013-10-31 16:17:04,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split	dst=null	perm=null
2013-10-31 16:17:04,362 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36058, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8399440944438708311_1319, duration: 171013
2013-10-31 16:17:04,363 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56164, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8399440944438708311_1319, duration: 320630
2013-10-31 16:17:04,368 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56165, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8399440944438708311_1319, duration: 330943
2013-10-31 16:17:04,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:04,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:04,403 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36061, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 324077
2013-10-31 16:17:04,404 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49164, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 255134
2013-10-31 16:17:04,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:04,410 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49165, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 149493
2013-10-31 16:17:04,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:04,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:04,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:04,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:04,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:04,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:04,617 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003. blk_8577440969405303007_1329
2013-10-31 16:17:04,624 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002. blk_777050699776076643_1329
2013-10-31 16:17:04,630 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004. blk_5223740880924984010_1329
2013-10-31 16:17:04,642 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8577440969405303007_1329 src: /127.0.0.1:36133 dest: /127.0.0.1:38271
2013-10-31 16:17:04,643 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8577440969405303007_1329 src: /127.0.0.1:36067 dest: /127.0.0.1:50942
2013-10-31 16:17:04,644 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8577440969405303007_1329 src: /127.0.0.1:49170 dest: /127.0.0.1:47311
2013-10-31 16:17:04,647 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49170, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8577440969405303007_1329, duration: 1428989
2013-10-31 16:17:04,649 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8577440969405303007_1329 terminating
2013-10-31 16:17:04,649 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777050699776076643_1329 src: /127.0.0.1:56170 dest: /127.0.0.1:41648
2013-10-31 16:17:04,649 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36067, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8577440969405303007_1329, duration: 4188607
2013-10-31 16:17:04,649 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8577440969405303007_1329 terminating
2013-10-31 16:17:04,649 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8577440969405303007_1329 size 92
2013-10-31 16:17:04,650 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36133, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8577440969405303007_1329, duration: 4754653
2013-10-31 16:17:04,650 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8577440969405303007_1329 size 92
2013-10-31 16:17:04,651 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8577440969405303007_1329 terminating
2013-10-31 16:17:04,650 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777050699776076643_1329 src: /127.0.0.1:36069 dest: /127.0.0.1:50942
2013-10-31 16:17:04,652 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777050699776076643_1329 src: /127.0.0.1:49172 dest: /127.0.0.1:47311
2013-10-31 16:17:04,653 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0028_m_000003_0
2013-10-31 16:17:04,653 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0028_m_000003_0
2013-10-31 16:17:04,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5223740880924984010_1329 src: /127.0.0.1:49168 dest: /127.0.0.1:47311
2013-10-31 16:17:04,654 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49172, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_777050699776076643_1329, duration: 1476550
2013-10-31 16:17:04,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5223740880924984010_1329 src: /127.0.0.1:36140 dest: /127.0.0.1:38271
2013-10-31 16:17:04,654 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_777050699776076643_1329 terminating
2013-10-31 16:17:04,654 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8577440969405303007_1329 size 92
2013-10-31 16:17:04,654 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36069, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777050699776076643_1329, duration: 1707696
2013-10-31 16:17:04,657 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_777050699776076643_1329 terminating
2013-10-31 16:17:04,659 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5223740880924984010_1329 src: /127.0.0.1:36072 dest: /127.0.0.1:50942
2013-10-31 16:17:04,659 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56170, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777050699776076643_1329, duration: 5727898
2013-10-31 16:17:04,659 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_777050699776076643_1329 size 92
2013-10-31 16:17:04,659 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_777050699776076643_1329 terminating
2013-10-31 16:17:04,659 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_777050699776076643_1329 size 92
2013-10-31 16:17:04,660 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_777050699776076643_1329 size 92
2013-10-31 16:17:04,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36072, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5223740880924984010_1329, duration: 746261
2013-10-31 16:17:04,661 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5223740880924984010_1329 terminating
2013-10-31 16:17:04,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36140, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5223740880924984010_1329, duration: 1049165
2013-10-31 16:17:04,661 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5223740880924984010_1329 terminating
2013-10-31 16:17:04,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49168, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5223740880924984010_1329, duration: 1435727
2013-10-31 16:17:04,662 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0028_m_000002_0
2013-10-31 16:17:04,662 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5223740880924984010_1329 terminating
2013-10-31 16:17:04,662 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0028_m_000002_0
2013-10-31 16:17:04,663 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5223740880924984010_1329 size 92
2013-10-31 16:17:04,664 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5223740880924984010_1329 size 92
2013-10-31 16:17:04,664 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0028_m_000004_0
2013-10-31 16:17:04,664 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0028_m_000004_0
2013-10-31 16:17:04,665 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5223740880924984010_1329 size 92
2013-10-31 16:17:04,699 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:04,699 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000003_0 0.0% 
2013-10-31 16:17:04,708 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:04,709 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000002_0 0.0% 
2013-10-31 16:17:04,711 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:04,711 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000004_0 0.0% 
2013-10-31 16:17:06,392 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000000_0
2013-10-31 16:17:06,510 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000002_0
2013-10-31 16:17:06,511 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000003_0
2013-10-31 16:17:06,554 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000004_0
2013-10-31 16:17:06,666 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:06,680 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:06,682 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:06,683 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000001_0 is done.
2013-10-31 16:17:06,684 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000001_0  was -1
2013-10-31 16:17:06,684 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:06,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0	dst=null	perm=null
2013-10-31 16:17:06,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:06,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0	dst=null	perm=null
2013-10-31 16:17:06,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0	dst=null	perm=null
2013-10-31 16:17:06,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:06,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:07,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0	dst=null	perm=null
2013-10-31 16:17:07,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:07,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:07,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:07,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004	dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:07,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:07,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0	dst=null	perm=null
2013-10-31 16:17:08,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0	dst=null	perm=null
2013-10-31 16:17:08,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0	dst=null	perm=null
2013-10-31 16:17:08,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0	dst=null	perm=null
2013-10-31 16:17:09,397 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000001_0' has completed task_20131031160444934_0028_m_000001 successfully.
2013-10-31 16:17:09,740 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:09,743 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:09,744 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000000_0 is done.
2013-10-31 16:17:09,744 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000000_0  was -1
2013-10-31 16:17:09,744 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:10,309 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:17:10,309 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:17:10,309 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:17:10,310 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:17:10,310 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:17:10,311 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:17:10,311 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000004_0 is done.
2013-10-31 16:17:10,311 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000002_0 is done.
2013-10-31 16:17:10,311 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000004_0  was -1
2013-10-31 16:17:10,311 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000002_0  was -1
2013-10-31 16:17:10,312 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:10,312 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000003_0 is done.
2013-10-31 16:17:10,312 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000003_0  was -1
2013-10-31 16:17:10,312 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:10,312 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:12,403 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000000_0' has completed task_20131031160444934_0028_m_000000 successfully.
2013-10-31 16:17:12,518 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000002_0' has completed task_20131031160444934_0028_m_000002 successfully.
2013-10-31 16:17:12,519 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000003_0' has completed task_20131031160444934_0028_m_000003 successfully.
2013-10-31 16:17:12,561 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000004_0' has completed task_20131031160444934_0028_m_000004 successfully.
2013-10-31 16:17:12,564 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0028_m_000005_0' to tip task_20131031160444934_0028_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:17:12,566 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:17:12,567 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000005_0 which needs 1 slots
2013-10-31 16:17:12,567 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000005_0 which needs 1 slots
2013-10-31 16:17:12,604 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_790895765
2013-10-31 16:17:12,607 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_790895765 spawned.
2013-10-31 16:17:12,608 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000005_0/taskjvm.sh
2013-10-31 16:17:13,574 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_790895765 given task: attempt_20131031160444934_0028_m_000005_0
2013-10-31 16:17:14,084 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000005_0 0.0% 
2013-10-31 16:17:14,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary	dst=null	perm=null
2013-10-31 16:17:14,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:14,112 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_SUCCESS from client DFSClient_attempt_20131031160444934_0028_m_000005_0
2013-10-31 16:17:14,113 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0028_m_000005_0
2013-10-31 16:17:14,120 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8815791525567125083 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:14,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8815791525567125083 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:14,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8815791525567125083 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:14,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8815791525567125083 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:14,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8399440944438708311 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:14,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8399440944438708311 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:14,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8399440944438708311 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:14,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8399440944438708311 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:14,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7961768246826946218 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:14,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7961768246826946218 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:14,123 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7961768246826946218 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:14,123 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1002969834028224173 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:14,123 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1002969834028224173 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:14,123 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1002969834028224173 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:14,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028	dst=null	perm=null
2013-10-31 16:17:15,320 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-8399440944438708311_1319 blk_-7961768246826946218_1320 blk_-8815791525567125083_1318
2013-10-31 16:17:15,321 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_1002969834028224173_1321 blk_-8399440944438708311_1319 blk_-7961768246826946218_1320 blk_-8815791525567125083_1318
2013-10-31 16:17:16,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8815791525567125083_1318 file build/test/data/dfs/data/data6/current/blk_-8815791525567125083 for deletion
2013-10-31 16:17:16,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8399440944438708311_1319 file build/test/data/dfs/data/data5/current/blk_-8399440944438708311 for deletion
2013-10-31 16:17:16,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7961768246826946218_1320 file build/test/data/dfs/data/data6/current/blk_-7961768246826946218 for deletion
2013-10-31 16:17:16,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8815791525567125083_1318 at file build/test/data/dfs/data/data6/current/blk_-8815791525567125083
2013-10-31 16:17:16,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8399440944438708311_1319 at file build/test/data/dfs/data/data5/current/blk_-8399440944438708311
2013-10-31 16:17:16,087 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7961768246826946218_1320 at file build/test/data/dfs/data/data6/current/blk_-7961768246826946218
2013-10-31 16:17:17,020 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000005_0 0.0% cleanup
2013-10-31 16:17:17,023 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000005_0 is done.
2013-10-31 16:17:17,023 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000005_0  was -1
2013-10-31 16:17:17,023 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:17,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8815791525567125083_1318 file build/test/data/dfs/data/data2/current/blk_-8815791525567125083 for deletion
2013-10-31 16:17:17,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8399440944438708311_1319 file build/test/data/dfs/data/data2/current/blk_-8399440944438708311 for deletion
2013-10-31 16:17:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7961768246826946218_1320 file build/test/data/dfs/data/data1/current/blk_-7961768246826946218 for deletion
2013-10-31 16:17:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8815791525567125083_1318 at file build/test/data/dfs/data/data2/current/blk_-8815791525567125083
2013-10-31 16:17:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1002969834028224173_1321 file build/test/data/dfs/data/data2/current/blk_1002969834028224173 for deletion
2013-10-31 16:17:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8399440944438708311_1319 at file build/test/data/dfs/data/data2/current/blk_-8399440944438708311
2013-10-31 16:17:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7961768246826946218_1320 at file build/test/data/dfs/data/data1/current/blk_-7961768246826946218
2013-10-31 16:17:17,876 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1002969834028224173_1321 at file build/test/data/dfs/data/data2/current/blk_1002969834028224173
2013-10-31 16:17:18,321 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_1002969834028224173_1321 blk_-8399440944438708311_1319 blk_-8815791525567125083_1318
2013-10-31 16:17:18,322 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_1002969834028224173_1321 blk_-8399440944438708311_1319 blk_-7961768246826946218_1320 blk_-8815791525567125083_1318
2013-10-31 16:17:18,474 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8815791525567125083_1318 file build/test/data/dfs/data/data4/current/blk_-8815791525567125083 for deletion
2013-10-31 16:17:18,474 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8399440944438708311_1319 file build/test/data/dfs/data/data3/current/blk_-8399440944438708311 for deletion
2013-10-31 16:17:18,474 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8815791525567125083_1318 at file build/test/data/dfs/data/data4/current/blk_-8815791525567125083
2013-10-31 16:17:18,474 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8399440944438708311_1319 at file build/test/data/dfs/data/data3/current/blk_-8399440944438708311
2013-10-31 16:17:18,474 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1002969834028224173_1321 file build/test/data/dfs/data/data4/current/blk_1002969834028224173 for deletion
2013-10-31 16:17:18,475 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1002969834028224173_1321 at file build/test/data/dfs/data/data4/current/blk_1002969834028224173
2013-10-31 16:17:18,574 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000005_0' has completed task_20131031160444934_0028_m_000005 successfully.
2013-10-31 16:17:18,575 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0028 has completed successfully.
2013-10-31 16:17:18,576 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0028,submitTime=1383236209815,launchTime=1383236209931,firstMapTaskLaunchTime=1383236217382,firstJobSetupTaskLaunchTime=1383236211362,firstJobCleanupTaskLaunchTime=1383236232564,finishTime=1383236238575,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=69,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E4EC0E4BA2CD4E49B23EC80C191F27BB/B61C99E02A3D4FD9997CF14CD9C7325E] lower*upper1*upper2/(3/3)
2013-10-31 16:17:18,580 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9. blk_2852820014732100186_1330
2013-10-31 16:17:18,582 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2852820014732100186_1330 src: /127.0.0.1:36145 dest: /127.0.0.1:38271
2013-10-31 16:17:18,585 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2852820014732100186_1330 src: /127.0.0.1:49179 dest: /127.0.0.1:47311
2013-10-31 16:17:18,586 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2852820014732100186_1330 src: /127.0.0.1:36078 dest: /127.0.0.1:50942
2013-10-31 16:17:18,592 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36078, dest: /127.0.0.1:50942, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2852820014732100186_1330, duration: 2328098
2013-10-31 16:17:18,593 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2852820014732100186_1330 terminating
2013-10-31 16:17:18,593 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49179, dest: /127.0.0.1:47311, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2852820014732100186_1330, duration: 3836902
2013-10-31 16:17:18,594 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2852820014732100186_1330 terminating
2013-10-31 16:17:18,594 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36145, dest: /127.0.0.1:38271, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2852820014732100186_1330, duration: 4748716
2013-10-31 16:17:18,594 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2852820014732100186_1330 size 26339
2013-10-31 16:17:18,595 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2852820014732100186_1330 terminating
2013-10-31 16:17:18,596 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2852820014732100186_1330 size 26339
2013-10-31 16:17:18,599 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9 from client DFSClient_-1085102077
2013-10-31 16:17:18,599 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9 is closed by DFSClient_-1085102077
2013-10-31 16:17:18,600 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2852820014732100186_1330 size 26339
2013-10-31 16:17:18,608 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:17:18,608 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000004_0'
2013-10-31 16:17:18,609 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000005_0'
2013-10-31 16:17:18,611 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3308714215337688669 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:18,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3308714215337688669 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:18,614 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0028
2013-10-31 16:17:18,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3308714215337688669 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:18,614 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0028 being deleted.
2013-10-31 16:17:18,616 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] starting step: (2/3)
2013-10-31 16:17:18,616 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0028_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:17:18,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028	dst=null	perm=null
2013-10-31 16:17:18,622 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:17:18,622 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:17:18,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:18,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:17:18,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,649 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar. blk_-5546483287794460021_1331
2013-10-31 16:17:18,650 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5546483287794460021_1331 src: /127.0.0.1:36149 dest: /127.0.0.1:38271
2013-10-31 16:17:18,652 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5546483287794460021_1331 src: /127.0.0.1:36081 dest: /127.0.0.1:50942
2013-10-31 16:17:18,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5546483287794460021_1331 src: /127.0.0.1:56187 dest: /127.0.0.1:41648
2013-10-31 16:17:18,664 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56187, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5546483287794460021_1331, duration: 7494529
2013-10-31 16:17:18,665 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5546483287794460021_1331 terminating
2013-10-31 16:17:18,665 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5546483287794460021_1331 size 238055
2013-10-31 16:17:18,665 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36081, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5546483287794460021_1331, duration: 8410243
2013-10-31 16:17:18,666 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5546483287794460021_1331 terminating
2013-10-31 16:17:18,666 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36149, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5546483287794460021_1331, duration: 9329373
2013-10-31 16:17:18,667 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5546483287794460021_1331 terminating
2013-10-31 16:17:18,667 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5546483287794460021_1331 size 238055
2013-10-31 16:17:18,670 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar from client DFSClient_1457307213
2013-10-31 16:17:18,670 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar is closed by DFSClient_1457307213
2013-10-31 16:17:18,671 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5546483287794460021_1331 size 238055
2013-10-31 16:17:18,679 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar. New replication is 10
2013-10-31 16:17:18,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar	dst=null	perm=null
2013-10-31 16:17:18,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,692 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:17:18,696 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:17:18,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:18,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,711 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split. New replication is 10
2013-10-31 16:17:18,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split	dst=null	perm=null
2013-10-31 16:17:18,717 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split. blk_6818519663719605632_1332
2013-10-31 16:17:18,719 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6818519663719605632_1332 src: /127.0.0.1:36152 dest: /127.0.0.1:38271
2013-10-31 16:17:18,721 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6818519663719605632_1332 src: /127.0.0.1:56189 dest: /127.0.0.1:41648
2013-10-31 16:17:18,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6818519663719605632_1332 src: /127.0.0.1:36085 dest: /127.0.0.1:50942
2013-10-31 16:17:18,724 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6818519663719605632_1332 src: /127.0.0.1:49188 dest: /127.0.0.1:47311
2013-10-31 16:17:18,727 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49188, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6818519663719605632_1332, duration: 85386
2013-10-31 16:17:18,728 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6818519663719605632_1332 terminating
2013-10-31 16:17:18,728 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36085, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6818519663719605632_1332, duration: 858343
2013-10-31 16:17:18,728 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6818519663719605632_1332 terminating
2013-10-31 16:17:18,729 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56189, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6818519663719605632_1332, duration: 1759486
2013-10-31 16:17:18,729 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6818519663719605632_1332 terminating
2013-10-31 16:17:18,730 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36152, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6818519663719605632_1332, duration: 2559698
2013-10-31 16:17:18,730 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6818519663719605632_1332 terminating
2013-10-31 16:17:18,733 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6818519663719605632_1332 size 1732
2013-10-31 16:17:18,733 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split from client DFSClient_1457307213
2013-10-31 16:17:18,734 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split is closed by DFSClient_1457307213
2013-10-31 16:17:18,734 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6818519663719605632_1332 size 1732
2013-10-31 16:17:18,734 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6818519663719605632_1332 size 1732
2013-10-31 16:17:18,735 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6818519663719605632_1332 size 1732
2013-10-31 16:17:18,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,751 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo. blk_-2835549027426087773_1333
2013-10-31 16:17:18,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2835549027426087773_1333 src: /127.0.0.1:56192 dest: /127.0.0.1:41648
2013-10-31 16:17:18,754 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2835549027426087773_1333 src: /127.0.0.1:36088 dest: /127.0.0.1:50942
2013-10-31 16:17:18,755 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2835549027426087773_1333 src: /127.0.0.1:49191 dest: /127.0.0.1:47311
2013-10-31 16:17:18,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49191, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2835549027426087773_1333, duration: 64856
2013-10-31 16:17:18,759 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2835549027426087773_1333 terminating
2013-10-31 16:17:18,759 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36088, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2835549027426087773_1333, duration: 889809
2013-10-31 16:17:18,760 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2835549027426087773_1333 terminating
2013-10-31 16:17:18,760 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56192, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2835549027426087773_1333, duration: 1704172
2013-10-31 16:17:18,760 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2835549027426087773_1333 size 183
2013-10-31 16:17:18,761 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2835549027426087773_1333 terminating
2013-10-31 16:17:18,762 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2835549027426087773_1333 size 183
2013-10-31 16:17:18,763 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2835549027426087773_1333 size 183
2013-10-31 16:17:18,763 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:17:18,764 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:17:18,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,786 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml. blk_4320670473446602513_1334
2013-10-31 16:17:18,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4320670473446602513_1334 src: /127.0.0.1:56195 dest: /127.0.0.1:41648
2013-10-31 16:17:18,789 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4320670473446602513_1334 src: /127.0.0.1:36091 dest: /127.0.0.1:50942
2013-10-31 16:17:18,791 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4320670473446602513_1334 src: /127.0.0.1:36161 dest: /127.0.0.1:38271
2013-10-31 16:17:18,794 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36161, dest: /127.0.0.1:38271, bytes: 28564, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4320670473446602513_1334, duration: 213189
2013-10-31 16:17:18,795 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4320670473446602513_1334 size 28564
2013-10-31 16:17:18,795 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4320670473446602513_1334 terminating
2013-10-31 16:17:18,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36091, dest: /127.0.0.1:50942, bytes: 28564, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4320670473446602513_1334, duration: 1163232
2013-10-31 16:17:18,796 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4320670473446602513_1334 terminating
2013-10-31 16:17:18,796 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56195, dest: /127.0.0.1:41648, bytes: 28564, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4320670473446602513_1334, duration: 2299839
2013-10-31 16:17:18,796 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4320670473446602513_1334 size 28564
2013-10-31 16:17:18,797 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4320670473446602513_1334 terminating
2013-10-31 16:17:18,799 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4320670473446602513_1334 size 28564
2013-10-31 16:17:18,799 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml from client DFSClient_1457307213
2013-10-31 16:17:18,800 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml is closed by DFSClient_1457307213
2013-10-31 16:17:19,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml	dst=null	perm=null
2013-10-31 16:17:19,391 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36094, bytes: 28788, op: HDFS_READ, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4320670473446602513_1334, duration: 474259
2013-10-31 16:17:19,410 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0029: nMaps=5 nReduces=0 max=-1
2013-10-31 16:17:19,410 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0029 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:17:19,411 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0029
2013-10-31 16:17:19,411 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0029	RESULT=SUCCESS
2013-10-31 16:17:19,411 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0029
2013-10-31 16:17:19,412 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] submitted hadoop job: job_20131031160444934_0029
2013-10-31 16:17:19,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:19,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:19,447 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_conf.xml. blk_7470160298863947644_1336
2013-10-31 16:17:19,448 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7470160298863947644_1336 src: /127.0.0.1:49197 dest: /127.0.0.1:47311
2013-10-31 16:17:19,450 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7470160298863947644_1336 src: /127.0.0.1:56201 dest: /127.0.0.1:41648
2013-10-31 16:17:19,452 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7470160298863947644_1336 src: /127.0.0.1:36097 dest: /127.0.0.1:50942
2013-10-31 16:17:19,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36097, dest: /127.0.0.1:50942, bytes: 28629, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7470160298863947644_1336, duration: 502817
2013-10-31 16:17:19,456 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7470160298863947644_1336 terminating
2013-10-31 16:17:19,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56201, dest: /127.0.0.1:41648, bytes: 28629, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7470160298863947644_1336, duration: 1854336
2013-10-31 16:17:19,457 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7470160298863947644_1336 terminating
2013-10-31 16:17:19,458 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49197, dest: /127.0.0.1:47311, bytes: 28629, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7470160298863947644_1336, duration: 2316954
2013-10-31 16:17:19,458 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7470160298863947644_1336 terminating
2013-10-31 16:17:19,462 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7470160298863947644_1336 size 28629
2013-10-31 16:17:19,462 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_conf.xml from client DFSClient_-350050235
2013-10-31 16:17:19,463 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_conf.xml is closed by DFSClient_-350050235
2013-10-31 16:17:19,463 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7470160298863947644_1336 size 28629
2013-10-31 16:17:19,463 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7470160298863947644_1336 size 28629
2013-10-31 16:17:19,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:19,477 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken. blk_-1641886665873571422_1337
2013-10-31 16:17:19,479 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1641886665873571422_1337 src: /127.0.0.1:36167 dest: /127.0.0.1:38271
2013-10-31 16:17:19,480 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1641886665873571422_1337 src: /127.0.0.1:49201 dest: /127.0.0.1:47311
2013-10-31 16:17:19,482 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1641886665873571422_1337 src: /127.0.0.1:56205 dest: /127.0.0.1:41648
2013-10-31 16:17:19,485 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56205, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1641886665873571422_1337, duration: 406759
2013-10-31 16:17:19,485 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1641886665873571422_1337 terminating
2013-10-31 16:17:19,486 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49201, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1641886665873571422_1337, duration: 1139611
2013-10-31 16:17:19,486 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1641886665873571422_1337 terminating
2013-10-31 16:17:19,487 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36167, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1641886665873571422_1337, duration: 2014838
2013-10-31 16:17:19,487 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1641886665873571422_1337 terminating
2013-10-31 16:17:19,490 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1641886665873571422_1337 size 116
2013-10-31 16:17:19,490 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1641886665873571422_1337 size 116
2013-10-31 16:17:19,490 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1641886665873571422_1337 size 116
2013-10-31 16:17:19,890 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken from client DFSClient_1457307213
2013-10-31 16:17:19,891 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken is closed by DFSClient_1457307213
2013-10-31 16:17:19,896 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken
2013-10-31 16:17:19,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:17:19,900 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36101, bytes: 187, op: HDFS_READ, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2835549027426087773_1333, duration: 269902
2013-10-31 16:17:19,901 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0029 = 19. Number of splits = 5
2013-10-31 16:17:19,902 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,902 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,902 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,902 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,903 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,903 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,903 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,903 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,905 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,905 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,905 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0029 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:17:19,906 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0029 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:17:21,085 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8815791525567125083_1318 file build/test/data/dfs/data/data8/current/blk_-8815791525567125083 for deletion
2013-10-31 16:17:21,085 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8399440944438708311_1319 file build/test/data/dfs/data/data7/current/blk_-8399440944438708311 for deletion
2013-10-31 16:17:21,085 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7961768246826946218_1320 file build/test/data/dfs/data/data8/current/blk_-7961768246826946218 for deletion
2013-10-31 16:17:21,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8399440944438708311_1319 at file build/test/data/dfs/data/data7/current/blk_-8399440944438708311
2013-10-31 16:17:21,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1002969834028224173_1321 file build/test/data/dfs/data/data7/current/blk_1002969834028224173 for deletion
2013-10-31 16:17:21,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8815791525567125083_1318 at file build/test/data/dfs/data/data8/current/blk_-8815791525567125083
2013-10-31 16:17:21,086 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1002969834028224173_1321 at file build/test/data/dfs/data/data7/current/blk_1002969834028224173
2013-10-31 16:17:21,087 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7961768246826946218_1320 at file build/test/data/dfs/data/data8/current/blk_-7961768246826946218
2013-10-31 16:17:21,323 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-5546483287794460021_1331 to datanode(s) 127.0.0.1:47311
2013-10-31 16:17:21,323 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-3308714215337688669_1324
2013-10-31 16:17:21,323 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-3308714215337688669_1324
2013-10-31 16:17:21,416 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0029_m_000006_0' to tip task_20131031160444934_0029_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:21,423 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000000_0'
2013-10-31 16:17:21,423 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000001_0'
2013-10-31 16:17:21,423 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000006_0'
2013-10-31 16:17:21,425 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:17:21,426 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000006_0 which needs 1 slots
2013-10-31 16:17:21,426 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000006_0 which needs 1 slots
2013-10-31 16:17:21,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken	dst=null	perm=null
2013-10-31 16:17:21,434 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36171, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1641886665873571422_1337, duration: 296908
2013-10-31 16:17:21,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml	dst=null	perm=null
2013-10-31 16:17:21,448 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36173, bytes: 28788, op: HDFS_READ, cliID: DFSClient_556233743, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4320670473446602513_1334, duration: 387239
2013-10-31 16:17:21,475 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:21,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar	dst=null	perm=null
2013-10-31 16:17:21,508 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36105, bytes: 239915, op: HDFS_READ, cliID: DFSClient_556233743, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5546483287794460021_1331, duration: 1490884
2013-10-31 16:17:21,529 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000002_0'
2013-10-31 16:17:21,530 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000003_0'
2013-10-31 16:17:21,602 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0028_m_1938196879
2013-10-31 16:17:21,609 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27570 with signal TERM. Exit code 0
2013-10-31 16:17:21,609 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-90922477
2013-10-31 16:17:21,610 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-90922477 spawned.
2013-10-31 16:17:21,611 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000006_0/taskjvm.sh
2013-10-31 16:17:22,086 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:22,086 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:22,086 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:22,086 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_1938196879 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:22,087 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3308714215337688669_1324 file build/test/data/dfs/data/data6/current/blk_-3308714215337688669 for deletion
2013-10-31 16:17:22,087 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3308714215337688669_1324 at file build/test/data/dfs/data/data6/current/blk_-3308714215337688669
2013-10-31 16:17:22,827 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-90922477 given task: attempt_20131031160444934_0029_m_000006_0
2013-10-31 16:17:23,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:23,611 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0028
2013-10-31 16:17:23,611 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000004_0 not found in cache
2013-10-31 16:17:23,611 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000005_0 not found in cache
2013-10-31 16:17:23,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0028 for user-log deletion with retainTimeStamp:1383322643612
2013-10-31 16:17:23,876 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3308714215337688669_1324 file build/test/data/dfs/data/data1/current/blk_-3308714215337688669 for deletion
2013-10-31 16:17:23,876 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3308714215337688669_1324 at file build/test/data/dfs/data/data1/current/blk_-3308714215337688669
2013-10-31 16:17:24,106 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-5546483287794460021_1331 to 127.0.0.1:47311 
2013-10-31 16:17:24,108 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5546483287794460021_1331 src: /127.0.0.1:49210 dest: /127.0.0.1:47311
2013-10-31 16:17:24,108 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-5546483287794460021_1331 to /127.0.0.1:47311
2013-10-31 16:17:24,111 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5546483287794460021_1331 src: /127.0.0.1:49210 dest: /127.0.0.1:47311 of size 238055
2013-10-31 16:17:24,116 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5546483287794460021_1331 size 238055
2013-10-31 16:17:24,324 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-3308714215337688669_1324
2013-10-31 16:17:24,349 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_594753817 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:24,359 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27676 with signal TERM. Exit code 0
2013-10-31 16:17:24,595 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:24,595 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:24,595 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:24,595 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_594753817 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:25,076 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_790895765 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:25,086 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27912 with signal TERM. Exit code 0
2013-10-31 16:17:25,260 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:25,261 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:25,261 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:25,261 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_790895765 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:26,272 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000006_0 0.0% setup
2013-10-31 16:17:26,275 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000006_0 is done.
2013-10-31 16:17:26,276 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000006_0  was -1
2013-10-31 16:17:26,276 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:26,426 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0028
2013-10-31 16:17:26,426 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000000_0 not found in cache
2013-10-31 16:17:26,427 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000001_0 not found in cache
2013-10-31 16:17:26,427 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0028 for user-log deletion with retainTimeStamp:1383322646427
2013-10-31 16:17:26,530 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0028
2013-10-31 16:17:26,531 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000002_0 not found in cache
2013-10-31 16:17:26,531 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000003_0 not found in cache
2013-10-31 16:17:26,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0028 for user-log deletion with retainTimeStamp:1383322646531
2013-10-31 16:17:26,732 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_-248337255 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:26,742 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27429 with signal TERM. Exit code 0
2013-10-31 16:17:26,983 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:26,983 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:26,983 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:26,983 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_-248337255 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:17:27,087 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3308714215337688669_1324 file build/test/data/dfs/data/data7/current/blk_-3308714215337688669 for deletion
2013-10-31 16:17:27,087 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3308714215337688669_1324 at file build/test/data/dfs/data/data7/current/blk_-3308714215337688669
2013-10-31 16:17:27,350 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_1931396390 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:27,360 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27659 with signal TERM. Exit code 0
2013-10-31 16:17:27,360 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_-887656516 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:27,371 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27677 with signal TERM. Exit code 0
2013-10-31 16:17:27,431 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000006_0' has completed task_20131031160444934_0029_m_000006 successfully.
2013-10-31 16:17:27,432 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000000_0' to tip task_20131031160444934_0029_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:27,433 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000000
2013-10-31 16:17:27,433 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000001_0' to tip task_20131031160444934_0029_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:27,433 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000001
2013-10-31 16:17:27,434 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:17:27,435 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:17:27,435 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000000_0 which needs 1 slots
2013-10-31 16:17:27,435 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000000_0 which needs 1 slots
2013-10-31 16:17:27,435 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000001_0 which needs 1 slots
2013-10-31 16:17:27,436 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0029_m_000001_0 which needs 1 slots
2013-10-31 16:17:27,464 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-1440454458
2013-10-31 16:17:27,464 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-1440454458 spawned.
2013-10-31 16:17:27,465 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000000_0/taskjvm.sh
2013-10-31 16:17:27,468 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0029/attempt_20131031160444934_0029_m_000001_0. Attempting to reuse: jvm_20131031160444934_0029_m_-90922477
2013-10-31 16:17:27,538 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000002_0' to tip task_20131031160444934_0029_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:17:27,538 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000002
2013-10-31 16:17:27,539 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000003_0' to tip task_20131031160444934_0029_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:17:27,540 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000003
2013-10-31 16:17:27,543 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:17:27,544 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:17:27,544 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000002_0 which needs 1 slots
2013-10-31 16:17:27,544 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000002_0 which needs 1 slots
2013-10-31 16:17:27,544 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000003_0 which needs 1 slots
2013-10-31 16:17:27,544 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0029_m_000003_0 which needs 1 slots
2013-10-31 16:17:27,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken	dst=null	perm=null
2013-10-31 16:17:27,550 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56215, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1641886665873571422_1337, duration: 320134
2013-10-31 16:17:27,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml	dst=null	perm=null
2013-10-31 16:17:27,555 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:27,555 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:27,555 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:27,555 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_-887656516 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:27,556 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36112, bytes: 28788, op: HDFS_READ, cliID: DFSClient_1171540499, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4320670473446602513_1334, duration: 187382
2013-10-31 16:17:27,561 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:27,561 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:27,561 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:27,561 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_1931396390 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:27,569 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:27,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar	dst=null	perm=null
2013-10-31 16:17:27,583 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36182, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1171540499, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5546483287794460021_1331, duration: 600858
2013-10-31 16:17:27,619 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000004_0' to tip task_20131031160444934_0029_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:17:27,620 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000004
2013-10-31 16:17:27,621 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:17:27,621 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000004_0 which needs 1 slots
2013-10-31 16:17:27,621 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000004_0 which needs 1 slots
2013-10-31 16:17:27,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken	dst=null	perm=null
2013-10-31 16:17:27,624 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49216, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1641886665873571422_1337, duration: 140171
2013-10-31 16:17:27,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml	dst=null	perm=null
2013-10-31 16:17:27,629 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36116, bytes: 28788, op: HDFS_READ, cliID: DFSClient_-1481985332, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4320670473446602513_1334, duration: 163725
2013-10-31 16:17:27,636 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-1587966514
2013-10-31 16:17:27,637 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-1587966514 spawned.
2013-10-31 16:17:27,637 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-1214579449
2013-10-31 16:17:27,639 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-1214579449 spawned.
2013-10-31 16:17:27,639 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000003_0/taskjvm.sh
2013-10-31 16:17:27,640 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000002_0/taskjvm.sh
2013-10-31 16:17:27,837 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-90922477 given task: attempt_20131031160444934_0029_m_000001_0
2013-10-31 16:17:27,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split	dst=null	perm=null
2013-10-31 16:17:27,937 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56223, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6818519663719605632_1332, duration: 168890
2013-10-31 16:17:27,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:27,976 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36119, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 101577
2013-10-31 16:17:28,314 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-1440454458 given task: attempt_20131031160444934_0029_m_000000_0
2013-10-31 16:17:28,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split	dst=null	perm=null
2013-10-31 16:17:28,809 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49224, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6818519663719605632_1332, duration: 164749
2013-10-31 16:17:28,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:30,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:30,146 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:30,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar	dst=null	perm=null
2013-10-31 16:17:30,161 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadBytes 75 raw values into 1 aggregated values, total 7
2013-10-31 16:17:30,162 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36123, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1481985332, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5546483287794460021_1331, duration: 890196
2013-10-31 16:17:30,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:30,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:30,240 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-1171757031
2013-10-31 16:17:30,241 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-1171757031 spawned.
2013-10-31 16:17:30,242 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000004_0/taskjvm.sh
2013-10-31 16:17:30,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:30,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=null
2013-10-31 16:17:30,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:30,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:30,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:30,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:30,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:30,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=null
2013-10-31 16:17:30,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:30,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:30,644 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36124, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_715915181680467880_1326, duration: 136130
2013-10-31 16:17:30,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:30,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:30,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:30,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:30,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:30,652 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56230, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4468907177856788027_1325, duration: 133031
2013-10-31 16:17:30,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:30,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:30,655 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56231, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777050699776076643_1329, duration: 116880
2013-10-31 16:17:30,655 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36196, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_715915181680467880_1326, duration: 108809
2013-10-31 16:17:30,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:30,658 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36128, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8577440969405303007_1329, duration: 105433
2013-10-31 16:17:30,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:30,660 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36198, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5223740880924984010_1329, duration: 99254
2013-10-31 16:17:30,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:30,664 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49232, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4468907177856788027_1325, duration: 114029
2013-10-31 16:17:30,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:30,667 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36131, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777050699776076643_1329, duration: 102340
2013-10-31 16:17:30,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:30,669 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001. blk_7018752213662655129_1339
2013-10-31 16:17:30,670 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36201, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8577440969405303007_1329, duration: 106317
2013-10-31 16:17:30,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:30,674 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36134, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5223740880924984010_1329, duration: 98896
2013-10-31 16:17:30,677 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56240, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 101594
2013-10-31 16:17:30,684 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000. blk_-1663768746748666765_1339
2013-10-31 16:17:30,688 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7018752213662655129_1339 src: /127.0.0.1:49235 dest: /127.0.0.1:47311
2013-10-31 16:17:30,689 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7018752213662655129_1339 src: /127.0.0.1:36206 dest: /127.0.0.1:38271
2013-10-31 16:17:30,690 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7018752213662655129_1339 src: /127.0.0.1:56243 dest: /127.0.0.1:41648
2013-10-31 16:17:30,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56243, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7018752213662655129_1339, duration: 1383497
2013-10-31 16:17:30,693 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7018752213662655129_1339 terminating
2013-10-31 16:17:30,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7018752213662655129_1339 size 104
2013-10-31 16:17:30,693 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36206, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7018752213662655129_1339, duration: 1947938
2013-10-31 16:17:30,693 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7018752213662655129_1339 terminating
2013-10-31 16:17:30,693 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49235, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7018752213662655129_1339, duration: 2462348
2013-10-31 16:17:30,693 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7018752213662655129_1339 terminating
2013-10-31 16:17:30,695 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0029_m_000001_0
2013-10-31 16:17:30,698 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0029_m_000001_0
2013-10-31 16:17:30,699 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7018752213662655129_1339 size 104
2013-10-31 16:17:30,699 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7018752213662655129_1339 size 104
2013-10-31 16:17:30,707 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1663768746748666765_1339 src: /127.0.0.1:49238 dest: /127.0.0.1:47311
2013-10-31 16:17:30,708 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1663768746748666765_1339 src: /127.0.0.1:56244 dest: /127.0.0.1:41648
2013-10-31 16:17:30,709 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1663768746748666765_1339 src: /127.0.0.1:36140 dest: /127.0.0.1:50942
2013-10-31 16:17:30,711 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36140, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1663768746748666765_1339, duration: 1213911
2013-10-31 16:17:30,712 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1663768746748666765_1339 terminating
2013-10-31 16:17:30,712 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1663768746748666765_1339 size 104
2013-10-31 16:17:30,712 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56244, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1663768746748666765_1339, duration: 1564587
2013-10-31 16:17:30,712 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1663768746748666765_1339 terminating
2013-10-31 16:17:30,712 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49238, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1663768746748666765_1339, duration: 2009110
2013-10-31 16:17:30,712 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1663768746748666765_1339 terminating
2013-10-31 16:17:30,713 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0029_m_000000_0
2013-10-31 16:17:30,714 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0029_m_000000_0
2013-10-31 16:17:30,714 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1663768746748666765_1339 size 104
2013-10-31 16:17:30,716 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1663768746748666765_1339 size 104
2013-10-31 16:17:30,740 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:30,740 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000001_0 0.0% 
2013-10-31 16:17:30,771 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:30,771 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000000_0 0.0% 
2013-10-31 16:17:31,012 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-1587966514 given task: attempt_20131031160444934_0029_m_000003_0
2013-10-31 16:17:31,219 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-1214579449 given task: attempt_20131031160444934_0029_m_000002_0
2013-10-31 16:17:31,387 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-1171757031 given task: attempt_20131031160444934_0029_m_000004_0
2013-10-31 16:17:31,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split	dst=null	perm=null
2013-10-31 16:17:31,507 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49248, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6818519663719605632_1332, duration: 164844
2013-10-31 16:17:31,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:31,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36147, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 136049
2013-10-31 16:17:31,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:31,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:31,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split	dst=null	perm=null
2013-10-31 16:17:31,738 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49251, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6818519663719605632_1332, duration: 364551
2013-10-31 16:17:31,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:31,779 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56255, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 268002
2013-10-31 16:17:31,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:31,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=null
2013-10-31 16:17:31,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:31,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:31,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:31,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:31,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:31,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:31,813 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49253, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_715915181680467880_1326, duration: 136349
2013-10-31 16:17:31,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:31,822 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36221, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4468907177856788027_1325, duration: 103590
2013-10-31 16:17:31,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:31,824 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56258, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777050699776076643_1329, duration: 113590
2013-10-31 16:17:31,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:31,827 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36223, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8577440969405303007_1329, duration: 102815
2013-10-31 16:17:31,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:31,830 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36224, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5223740880924984010_1329, duration: 101063
2013-10-31 16:17:32,167 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003. blk_6018207326177541389_1341
2013-10-31 16:17:32,201 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6018207326177541389_1341 src: /127.0.0.1:36157 dest: /127.0.0.1:50942
2013-10-31 16:17:32,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6018207326177541389_1341 src: /127.0.0.1:49260 dest: /127.0.0.1:47311
2013-10-31 16:17:32,220 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6018207326177541389_1341 src: /127.0.0.1:36228 dest: /127.0.0.1:38271
2013-10-31 16:17:32,223 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36228, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6018207326177541389_1341, duration: 1355152
2013-10-31 16:17:32,223 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6018207326177541389_1341 terminating
2013-10-31 16:17:32,223 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49260, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6018207326177541389_1341, duration: 1471414
2013-10-31 16:17:32,224 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6018207326177541389_1341 terminating
2013-10-31 16:17:32,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36157, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6018207326177541389_1341, duration: 2322780
2013-10-31 16:17:32,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6018207326177541389_1341 terminating
2013-10-31 16:17:32,226 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6018207326177541389_1341 size 104
2013-10-31 16:17:32,227 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6018207326177541389_1341 size 104
2013-10-31 16:17:32,227 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6018207326177541389_1341 size 104
2013-10-31 16:17:32,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split	dst=null	perm=null
2013-10-31 16:17:32,259 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36229, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6818519663719605632_1332, duration: 427676
2013-10-31 16:17:32,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:17:32,302 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49263, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 248505
2013-10-31 16:17:32,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:32,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:32,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:32,435 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0029_m_000006_0
2013-10-31 16:17:32,436 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0029_m_000006_0
2013-10-31 16:17:32,436 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000006_0 not found in cache
2013-10-31 16:17:32,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=null
2013-10-31 16:17:32,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:32,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:32,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:32,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:32,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:32,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:32,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36162, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_715915181680467880_1326, duration: 130910
2013-10-31 16:17:32,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:32,566 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36232, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4468907177856788027_1325, duration: 107643
2013-10-31 16:17:32,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:32,569 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36164, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777050699776076643_1329, duration: 100478
2013-10-31 16:17:32,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:32,572 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49267, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8577440969405303007_1329, duration: 100458
2013-10-31 16:17:32,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:32,575 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36166, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5223740880924984010_1329, duration: 100154
2013-10-31 16:17:32,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=null
2013-10-31 16:17:32,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:32,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:32,584 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002. blk_-4668368595109805817_1342
2013-10-31 16:17:32,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:32,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:32,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:32,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000	dst=null	perm=null
2013-10-31 16:17:32,592 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36237, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_715915181680467880_1326, duration: 129935
2013-10-31 16:17:32,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001	dst=null	perm=null
2013-10-31 16:17:32,600 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36238, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4468907177856788027_1325, duration: 109826
2013-10-31 16:17:32,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002	dst=null	perm=null
2013-10-31 16:17:32,604 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36170, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777050699776076643_1329, duration: 100608
2013-10-31 16:17:32,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003	dst=null	perm=null
2013-10-31 16:17:32,606 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36171, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8577440969405303007_1329, duration: 125734
2013-10-31 16:17:32,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4668368595109805817_1342 src: /127.0.0.1:56272 dest: /127.0.0.1:41648
2013-10-31 16:17:32,608 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4668368595109805817_1342 src: /127.0.0.1:36172 dest: /127.0.0.1:50942
2013-10-31 16:17:32,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004	dst=null	perm=null
2013-10-31 16:17:32,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4668368595109805817_1342 src: /127.0.0.1:49275 dest: /127.0.0.1:47311
2013-10-31 16:17:32,609 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36174, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5223740880924984010_1329, duration: 104286
2013-10-31 16:17:32,611 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49275, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4668368595109805817_1342, duration: 1031625
2013-10-31 16:17:32,611 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4668368595109805817_1342 terminating
2013-10-31 16:17:32,611 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4668368595109805817_1342 size 104
2013-10-31 16:17:32,611 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36172, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4668368595109805817_1342, duration: 1492502
2013-10-31 16:17:32,612 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4668368595109805817_1342 terminating
2013-10-31 16:17:32,612 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56272, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 1945548
2013-10-31 16:17:32,612 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4668368595109805817_1342 terminating
2013-10-31 16:17:32,613 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0029_m_000002_0
2013-10-31 16:17:32,613 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0029_m_000002_0
2013-10-31 16:17:32,614 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4668368595109805817_1342 size 104
2013-10-31 16:17:32,616 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4668368595109805817_1342 size 104
2013-10-31 16:17:32,619 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004. blk_-1513594355081957583_1342
2013-10-31 16:17:32,626 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0029_m_000003_0
2013-10-31 16:17:32,627 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0029_m_000003_0
2013-10-31 16:17:32,641 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1513594355081957583_1342 src: /127.0.0.1:36175 dest: /127.0.0.1:50942
2013-10-31 16:17:32,642 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1513594355081957583_1342 src: /127.0.0.1:49278 dest: /127.0.0.1:47311
2013-10-31 16:17:32,643 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1513594355081957583_1342 src: /127.0.0.1:36246 dest: /127.0.0.1:38271
2013-10-31 16:17:32,645 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36246, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1513594355081957583_1342, duration: 1010123
2013-10-31 16:17:32,645 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1513594355081957583_1342 terminating
2013-10-31 16:17:32,645 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49278, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1513594355081957583_1342, duration: 1493953
2013-10-31 16:17:32,645 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1513594355081957583_1342 terminating
2013-10-31 16:17:32,645 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36175, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1513594355081957583_1342, duration: 1844026
2013-10-31 16:17:32,646 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1513594355081957583_1342 terminating
2013-10-31 16:17:32,646 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1513594355081957583_1342 size 104
2013-10-31 16:17:32,646 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0029_m_000004_0
2013-10-31 16:17:32,647 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0029_m_000004_0
2013-10-31 16:17:32,649 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1513594355081957583_1342 size 104
2013-10-31 16:17:32,649 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1513594355081957583_1342 size 104
2013-10-31 16:17:32,660 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:32,660 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000002_0 0.0% 
2013-10-31 16:17:32,682 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:32,682 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000003_0 0.0% 
2013-10-31 16:17:32,693 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:32,694 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000004_0 0.0% 
2013-10-31 16:17:33,438 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000000_0
2013-10-31 16:17:33,438 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000001_0
2013-10-31 16:17:33,547 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000002_0
2013-10-31 16:17:33,548 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000003_0
2013-10-31 16:17:33,623 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000004_0
2013-10-31 16:17:33,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0	dst=null	perm=null
2013-10-31 16:17:33,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0	dst=null	perm=null
2013-10-31 16:17:33,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0	dst=null	perm=null
2013-10-31 16:17:33,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0	dst=null	perm=null
2013-10-31 16:17:33,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0	dst=null	perm=null
2013-10-31 16:17:33,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,930 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:33,983 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_7127116701397707812_1204
2013-10-31 16:17:34,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004	dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0	dst=null	perm=null
2013-10-31 16:17:34,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0	dst=null	perm=null
2013-10-31 16:17:34,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0	dst=null	perm=null
2013-10-31 16:17:34,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0	dst=null	perm=null
2013-10-31 16:17:34,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0	dst=null	perm=null
2013-10-31 16:17:34,435 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:17:34,436 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000003_0 is done.
2013-10-31 16:17:34,437 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000003_0  was -1
2013-10-31 16:17:34,437 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:34,658 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:17:34,659 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000002_0 is done.
2013-10-31 16:17:34,659 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000002_0  was -1
2013-10-31 16:17:34,659 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:34,796 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:34,799 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:34,800 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000000_0 is done.
2013-10-31 16:17:34,800 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000000_0  was -1
2013-10-31 16:17:34,800 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:35,172 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:17:35,173 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000004_0 is done.
2013-10-31 16:17:35,174 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000004_0  was -1
2013-10-31 16:17:35,174 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:36,442 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000000_0' has completed task_20131031160444934_0029_m_000000 successfully.
2013-10-31 16:17:36,552 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000002_0' has completed task_20131031160444934_0029_m_000002 successfully.
2013-10-31 16:17:36,554 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000003_0' has completed task_20131031160444934_0029_m_000003 successfully.
2013-10-31 16:17:36,627 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000004_0' has completed task_20131031160444934_0029_m_000004 successfully.
2013-10-31 16:17:36,979 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:36,982 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:36,983 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000001_0 is done.
2013-10-31 16:17:36,983 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000001_0  was -1
2013-10-31 16:17:36,984 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:39,448 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000001_0' has completed task_20131031160444934_0029_m_000001 successfully.
2013-10-31 16:17:39,451 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0029_m_000005_0' to tip task_20131031160444934_0029_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:39,454 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:17:39,454 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000005_0 which needs 1 slots
2013-10-31 16:17:39,455 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000005_0 which needs 1 slots
2013-10-31 16:17:39,490 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0029/attempt_20131031160444934_0029_m_000005_0. Attempting to reuse: jvm_20131031160444934_0029_m_-90922477
2013-10-31 16:17:39,847 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:17:39,864 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,875 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,881 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,886 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,892 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,892 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 16:17:40,506 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-90922477 given task: attempt_20131031160444934_0029_m_000005_0
2013-10-31 16:17:40,612 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000005_0 0.0% 
2013-10-31 16:17:40,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary	dst=null	perm=null
2013-10-31 16:17:40,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:40,629 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_SUCCESS from client DFSClient_attempt_20131031160444934_0029_m_000005_0
2013-10-31 16:17:40,629 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0029_m_000005_0
2013-10-31 16:17:40,635 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5546483287794460021 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:40,635 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5546483287794460021 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:40,635 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5546483287794460021 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:40,635 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5546483287794460021 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:40,635 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6818519663719605632 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:40,636 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6818519663719605632 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:40,636 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6818519663719605632 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:40,636 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6818519663719605632 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:40,636 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2835549027426087773 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:40,636 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2835549027426087773 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:40,636 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2835549027426087773 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:40,636 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4320670473446602513 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:40,636 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4320670473446602513 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:40,637 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4320670473446602513 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:40,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029	dst=null	perm=null
2013-10-31 16:17:42,327 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-2835549027426087773_1333 blk_-5546483287794460021_1331 blk_6818519663719605632_1332 blk_4320670473446602513_1334
2013-10-31 16:17:42,328 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-2835549027426087773_1333 blk_-5546483287794460021_1331 blk_6818519663719605632_1332
2013-10-31 16:17:42,482 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5546483287794460021_1331 file build/test/data/dfs/data/data4/current/blk_-5546483287794460021 for deletion
2013-10-31 16:17:42,482 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2835549027426087773_1333 file build/test/data/dfs/data/data3/current/blk_-2835549027426087773 for deletion
2013-10-31 16:17:42,482 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6818519663719605632_1332 file build/test/data/dfs/data/data4/current/blk_6818519663719605632 for deletion
2013-10-31 16:17:42,483 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2835549027426087773_1333 at file build/test/data/dfs/data/data3/current/blk_-2835549027426087773
2013-10-31 16:17:42,482 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5546483287794460021_1331 at file build/test/data/dfs/data/data4/current/blk_-5546483287794460021
2013-10-31 16:17:42,483 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6818519663719605632_1332 at file build/test/data/dfs/data/data4/current/blk_6818519663719605632
2013-10-31 16:17:43,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5546483287794460021_1331 file build/test/data/dfs/data/data5/current/blk_-5546483287794460021 for deletion
2013-10-31 16:17:43,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2835549027426087773_1333 file build/test/data/dfs/data/data5/current/blk_-2835549027426087773 for deletion
2013-10-31 16:17:43,096 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5546483287794460021_1331 at file build/test/data/dfs/data/data5/current/blk_-5546483287794460021
2013-10-31 16:17:43,096 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4320670473446602513_1334 file build/test/data/dfs/data/data6/current/blk_4320670473446602513 for deletion
2013-10-31 16:17:43,096 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2835549027426087773_1333 at file build/test/data/dfs/data/data5/current/blk_-2835549027426087773
2013-10-31 16:17:43,096 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6818519663719605632_1332 file build/test/data/dfs/data/data6/current/blk_6818519663719605632 for deletion
2013-10-31 16:17:43,096 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4320670473446602513_1334 at file build/test/data/dfs/data/data6/current/blk_4320670473446602513
2013-10-31 16:17:43,097 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6818519663719605632_1332 at file build/test/data/dfs/data/data6/current/blk_6818519663719605632
2013-10-31 16:17:43,589 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000005_0 0.0% cleanup
2013-10-31 16:17:43,591 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000005_0 is done.
2013-10-31 16:17:43,591 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000005_0  was -1
2013-10-31 16:17:43,591 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:45,328 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-2835549027426087773_1333 blk_-5546483287794460021_1331 blk_6818519663719605632_1332 blk_4320670473446602513_1334
2013-10-31 16:17:45,328 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5546483287794460021_1331 blk_6818519663719605632_1332 blk_4320670473446602513_1334
2013-10-31 16:17:45,463 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000005_0' has completed task_20131031160444934_0029_m_000005 successfully.
2013-10-31 16:17:45,464 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0029 has completed successfully.
2013-10-31 16:17:45,464 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0029,submitTime=1383236239381,launchTime=1383236239905,firstMapTaskLaunchTime=1383236247432,firstJobSetupTaskLaunchTime=1383236241416,firstJobCleanupTaskLaunchTime=1383236259451,finishTime=1383236265464,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=44,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E4EC0E4BA2CD4E49B23EC80C191F27BB/B7FAAC861D56461B99ECD9CA24C0A34C] lower*upper1*upper2/(2/3)
2013-10-31 16:17:45,471 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B. blk_-4844518074889198090_1343
2013-10-31 16:17:45,473 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4844518074889198090_1343 src: /127.0.0.1:49285 dest: /127.0.0.1:47311
2013-10-31 16:17:45,475 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4844518074889198090_1343 src: /127.0.0.1:36253 dest: /127.0.0.1:38271
2013-10-31 16:17:45,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4844518074889198090_1343 src: /127.0.0.1:56290 dest: /127.0.0.1:41648
2013-10-31 16:17:45,487 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56290, dest: /127.0.0.1:41648, bytes: 26357, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4844518074889198090_1343, duration: 4099176
2013-10-31 16:17:45,488 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4844518074889198090_1343 terminating
2013-10-31 16:17:45,488 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36253, dest: /127.0.0.1:38271, bytes: 26357, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4844518074889198090_1343, duration: 5579161
2013-10-31 16:17:45,489 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4844518074889198090_1343 terminating
2013-10-31 16:17:45,489 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49285, dest: /127.0.0.1:47311, bytes: 26357, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4844518074889198090_1343, duration: 6222455
2013-10-31 16:17:45,489 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4844518074889198090_1343 terminating
2013-10-31 16:17:45,496 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4844518074889198090_1343 size 26357
2013-10-31 16:17:45,498 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B from client DFSClient_-350050235
2013-10-31 16:17:45,500 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B is closed by DFSClient_-350050235
2013-10-31 16:17:45,500 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4844518074889198090_1343 size 26357
2013-10-31 16:17:45,501 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4844518074889198090_1343 size 26357
2013-10-31 16:17:45,522 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:17:45,523 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000000_0'
2013-10-31 16:17:45,525 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000001_0'
2013-10-31 16:17:45,525 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000005_0'
2013-10-31 16:17:45,525 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000006_0'
2013-10-31 16:17:45,526 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1641886665873571422 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:45,527 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1641886665873571422 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:45,527 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1641886665873571422 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:45,531 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0029_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:17:45,531 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] starting step: (1/3) ...rm/joinsamesourceintojoin
2013-10-31 16:17:45,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029	dst=null	perm=null
2013-10-31 16:17:45,537 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:17:45,537 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:17:45,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:45,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:17:45,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,563 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar. blk_-8492324455653831791_1344
2013-10-31 16:17:45,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8492324455653831791_1344 src: /127.0.0.1:36256 dest: /127.0.0.1:38271
2013-10-31 16:17:45,565 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000002_0'
2013-10-31 16:17:45,566 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000003_0'
2013-10-31 16:17:45,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8492324455653831791_1344 src: /127.0.0.1:49290 dest: /127.0.0.1:47311
2013-10-31 16:17:45,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8492324455653831791_1344 src: /127.0.0.1:56294 dest: /127.0.0.1:41648
2013-10-31 16:17:45,575 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56294, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8492324455653831791_1344, duration: 3803381
2013-10-31 16:17:45,576 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8492324455653831791_1344 terminating
2013-10-31 16:17:45,576 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49290, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8492324455653831791_1344, duration: 3992986
2013-10-31 16:17:45,577 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8492324455653831791_1344 terminating
2013-10-31 16:17:45,577 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36256, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8492324455653831791_1344, duration: 5776421
2013-10-31 16:17:45,578 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8492324455653831791_1344 terminating
2013-10-31 16:17:45,580 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8492324455653831791_1344 size 238055
2013-10-31 16:17:45,580 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar from client DFSClient_1457307213
2013-10-31 16:17:45,580 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar is closed by DFSClient_1457307213
2013-10-31 16:17:45,581 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8492324455653831791_1344 size 238055
2013-10-31 16:17:45,582 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8492324455653831791_1344 size 238055
2013-10-31 16:17:45,587 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar. New replication is 10
2013-10-31 16:17:45,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar	dst=null	perm=null
2013-10-31 16:17:45,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,601 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:17:45,605 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:17:45,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:17:45,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,621 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split. New replication is 10
2013-10-31 16:17:45,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split	dst=null	perm=null
2013-10-31 16:17:45,628 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split. blk_1824606275897357057_1345
2013-10-31 16:17:45,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1824606275897357057_1345 src: /127.0.0.1:56295 dest: /127.0.0.1:41648
2013-10-31 16:17:45,632 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1824606275897357057_1345 src: /127.0.0.1:36260 dest: /127.0.0.1:38271
2013-10-31 16:17:45,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1824606275897357057_1345 src: /127.0.0.1:36192 dest: /127.0.0.1:50942
2013-10-31 16:17:45,635 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1824606275897357057_1345 src: /127.0.0.1:49295 dest: /127.0.0.1:47311
2013-10-31 16:17:45,638 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000004_0'
2013-10-31 16:17:45,639 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0029
2013-10-31 16:17:45,640 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0029 being deleted.
2013-10-31 16:17:45,640 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49295, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1824606275897357057_1345, duration: 2554126
2013-10-31 16:17:45,640 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1824606275897357057_1345 terminating
2013-10-31 16:17:45,640 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1824606275897357057_1345 size 1732
2013-10-31 16:17:45,641 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36192, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1824606275897357057_1345, duration: 3103212
2013-10-31 16:17:45,642 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1824606275897357057_1345 terminating
2013-10-31 16:17:45,642 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36260, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1824606275897357057_1345, duration: 2076649
2013-10-31 16:17:45,643 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1824606275897357057_1345 terminating
2013-10-31 16:17:45,643 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1824606275897357057_1345 size 1732
2013-10-31 16:17:45,643 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56295, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1824606275897357057_1345, duration: 3174618
2013-10-31 16:17:45,644 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_1824606275897357057_1345 terminating
2013-10-31 16:17:45,645 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1824606275897357057_1345 size 1732
2013-10-31 16:17:45,646 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split from client DFSClient_1457307213
2013-10-31 16:17:45,646 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split is closed by DFSClient_1457307213
2013-10-31 16:17:45,648 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1824606275897357057_1345 size 1732
2013-10-31 16:17:45,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,664 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo. blk_-6914640943678526682_1346
2013-10-31 16:17:45,666 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6914640943678526682_1346 src: /127.0.0.1:56299 dest: /127.0.0.1:41648
2013-10-31 16:17:45,668 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6914640943678526682_1346 src: /127.0.0.1:36195 dest: /127.0.0.1:50942
2013-10-31 16:17:45,669 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6914640943678526682_1346 src: /127.0.0.1:36265 dest: /127.0.0.1:38271
2013-10-31 16:17:45,674 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36265, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6914640943678526682_1346, duration: 67957
2013-10-31 16:17:45,675 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6914640943678526682_1346 terminating
2013-10-31 16:17:45,676 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6914640943678526682_1346 size 183
2013-10-31 16:17:45,676 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36195, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6914640943678526682_1346, duration: 2052177
2013-10-31 16:17:45,678 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6914640943678526682_1346 terminating
2013-10-31 16:17:45,678 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56299, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6914640943678526682_1346, duration: 3803721
2013-10-31 16:17:45,679 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6914640943678526682_1346 size 183
2013-10-31 16:17:45,679 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6914640943678526682_1346 terminating
2013-10-31 16:17:45,681 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6914640943678526682_1346 size 183
2013-10-31 16:17:45,681 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:17:45,682 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:17:45,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,716 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml. blk_-8878127457679220121_1347
2013-10-31 16:17:45,717 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8878127457679220121_1347 src: /127.0.0.1:56302 dest: /127.0.0.1:41648
2013-10-31 16:17:45,719 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8878127457679220121_1347 src: /127.0.0.1:36198 dest: /127.0.0.1:50942
2013-10-31 16:17:45,720 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8878127457679220121_1347 src: /127.0.0.1:36268 dest: /127.0.0.1:38271
2013-10-31 16:17:45,723 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36268, dest: /127.0.0.1:38271, bytes: 28707, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8878127457679220121_1347, duration: 66309
2013-10-31 16:17:45,724 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8878127457679220121_1347 terminating
2013-10-31 16:17:45,724 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8878127457679220121_1347 size 28707
2013-10-31 16:17:45,724 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36198, dest: /127.0.0.1:50942, bytes: 28707, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8878127457679220121_1347, duration: 827134
2013-10-31 16:17:45,725 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8878127457679220121_1347 terminating
2013-10-31 16:17:45,725 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56302, dest: /127.0.0.1:41648, bytes: 28707, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8878127457679220121_1347, duration: 1827844
2013-10-31 16:17:45,725 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8878127457679220121_1347 terminating
2013-10-31 16:17:45,729 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8878127457679220121_1347 size 28707
2013-10-31 16:17:45,729 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml from client DFSClient_1457307213
2013-10-31 16:17:45,730 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml is closed by DFSClient_1457307213
2013-10-31 16:17:45,730 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8878127457679220121_1347 size 28707
2013-10-31 16:17:45,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml	dst=null	perm=null
2013-10-31 16:17:45,749 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56306, bytes: 28935, op: HDFS_READ, cliID: DFSClient_695084204, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8878127457679220121_1347, duration: 398556
2013-10-31 16:17:45,766 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0030: nMaps=5 nReduces=0 max=-1
2013-10-31 16:17:45,767 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0030 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:17:45,767 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0030	RESULT=SUCCESS
2013-10-31 16:17:45,767 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0030
2013-10-31 16:17:45,767 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0030
2013-10-31 16:17:45,767 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] submitted hadoop job: job_20131031160444934_0030
2013-10-31 16:17:47,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:47,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:47,276 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_conf.xml. blk_820581296167968970_1349
2013-10-31 16:17:47,277 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_820581296167968970_1349 src: /127.0.0.1:36202 dest: /127.0.0.1:50942
2013-10-31 16:17:47,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_820581296167968970_1349 src: /127.0.0.1:56308 dest: /127.0.0.1:41648
2013-10-31 16:17:47,279 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_820581296167968970_1349 src: /127.0.0.1:36273 dest: /127.0.0.1:38271
2013-10-31 16:17:47,282 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36273, dest: /127.0.0.1:38271, bytes: 28772, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_820581296167968970_1349, duration: 96870
2013-10-31 16:17:47,282 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_820581296167968970_1349 size 28772
2013-10-31 16:17:47,282 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_820581296167968970_1349 terminating
2013-10-31 16:17:47,283 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56308, dest: /127.0.0.1:41648, bytes: 28772, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_820581296167968970_1349, duration: 1009409
2013-10-31 16:17:47,284 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_820581296167968970_1349 terminating
2013-10-31 16:17:47,284 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36202, dest: /127.0.0.1:50942, bytes: 28772, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_820581296167968970_1349, duration: 2555957
2013-10-31 16:17:47,284 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_820581296167968970_1349 terminating
2013-10-31 16:17:47,287 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_820581296167968970_1349 size 28772
2013-10-31 16:17:47,288 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_820581296167968970_1349 size 28772
2013-10-31 16:17:47,291 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_conf.xml from client DFSClient_695084204
2013-10-31 16:17:47,291 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_conf.xml is closed by DFSClient_695084204
2013-10-31 16:17:47,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:47,305 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken. blk_-5985565395941547146_1350
2013-10-31 16:17:47,307 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5985565395941547146_1350 src: /127.0.0.1:36205 dest: /127.0.0.1:50942
2013-10-31 16:17:47,308 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5985565395941547146_1350 src: /127.0.0.1:49308 dest: /127.0.0.1:47311
2013-10-31 16:17:47,310 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5985565395941547146_1350 src: /127.0.0.1:36276 dest: /127.0.0.1:38271
2013-10-31 16:17:47,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36276, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5985565395941547146_1350, duration: 67632
2013-10-31 16:17:47,313 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5985565395941547146_1350 terminating
2013-10-31 16:17:47,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49308, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5985565395941547146_1350, duration: 834445
2013-10-31 16:17:47,314 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5985565395941547146_1350 terminating
2013-10-31 16:17:47,314 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36205, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5985565395941547146_1350, duration: 1625507
2013-10-31 16:17:47,314 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5985565395941547146_1350 size 116
2013-10-31 16:17:47,315 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5985565395941547146_1350 terminating
2013-10-31 16:17:47,317 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5985565395941547146_1350 size 116
2013-10-31 16:17:47,318 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken from client DFSClient_1457307213
2013-10-31 16:17:47,318 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken is closed by DFSClient_1457307213
2013-10-31 16:17:47,318 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5985565395941547146_1350 size 116
2013-10-31 16:17:47,324 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken
2013-10-31 16:17:47,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:17:47,328 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36277, bytes: 187, op: HDFS_READ, cliID: DFSClient_695084204, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6914640943678526682_1346, duration: 275800
2013-10-31 16:17:47,329 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0030 = 19. Number of splits = 5
2013-10-31 16:17:47,330 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,330 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,330 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,330 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,331 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,331 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,331 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,331 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,333 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,333 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,333 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0030 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:17:47,334 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0030 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:17:47,884 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5546483287794460021_1331 file build/test/data/dfs/data/data2/current/blk_-5546483287794460021 for deletion
2013-10-31 16:17:47,884 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4320670473446602513_1334 file build/test/data/dfs/data/data2/current/blk_4320670473446602513 for deletion
2013-10-31 16:17:47,884 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5546483287794460021_1331 at file build/test/data/dfs/data/data2/current/blk_-5546483287794460021
2013-10-31 16:17:47,884 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6818519663719605632_1332 file build/test/data/dfs/data/data1/current/blk_6818519663719605632 for deletion
2013-10-31 16:17:47,885 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4320670473446602513_1334 at file build/test/data/dfs/data/data2/current/blk_4320670473446602513
2013-10-31 16:17:47,885 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6818519663719605632_1332 at file build/test/data/dfs/data/data1/current/blk_6818519663719605632
2013-10-31 16:17:48,094 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5546483287794460021_1331 file build/test/data/dfs/data/data7/current/blk_-5546483287794460021 for deletion
2013-10-31 16:17:48,094 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2835549027426087773_1333 file build/test/data/dfs/data/data7/current/blk_-2835549027426087773 for deletion
2013-10-31 16:17:48,094 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4320670473446602513_1334 file build/test/data/dfs/data/data8/current/blk_4320670473446602513 for deletion
2013-10-31 16:17:48,094 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5546483287794460021_1331 at file build/test/data/dfs/data/data7/current/blk_-5546483287794460021
2013-10-31 16:17:48,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4320670473446602513_1334 at file build/test/data/dfs/data/data8/current/blk_4320670473446602513
2013-10-31 16:17:48,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2835549027426087773_1333 at file build/test/data/dfs/data/data7/current/blk_-2835549027426087773
2013-10-31 16:17:48,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6818519663719605632_1332 file build/test/data/dfs/data/data8/current/blk_6818519663719605632 for deletion
2013-10-31 16:17:48,096 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6818519663719605632_1332 at file build/test/data/dfs/data/data8/current/blk_6818519663719605632
2013-10-31 16:17:48,329 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-8492324455653831791_1344 to datanode(s) 127.0.0.1:50942
2013-10-31 16:17:48,330 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-1641886665873571422_1337
2013-10-31 16:17:48,330 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-1641886665873571422_1337
2013-10-31 16:17:48,484 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1641886665873571422_1337 file build/test/data/dfs/data/data3/current/blk_-1641886665873571422 for deletion
2013-10-31 16:17:48,484 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1641886665873571422_1337 at file build/test/data/dfs/data/data3/current/blk_-1641886665873571422
2013-10-31 16:17:48,531 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0030_m_000006_0' to tip task_20131031160444934_0030_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:48,537 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:17:48,538 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000006_0 which needs 1 slots
2013-10-31 16:17:48,538 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000006_0 which needs 1 slots
2013-10-31 16:17:48,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken	dst=null	perm=null
2013-10-31 16:17:48,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36278, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5985565395941547146_1350, duration: 346507
2013-10-31 16:17:48,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml	dst=null	perm=null
2013-10-31 16:17:48,557 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36280, bytes: 28935, op: HDFS_READ, cliID: DFSClient_-1661306941, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8878127457679220121_1347, duration: 370631
2013-10-31 16:17:48,591 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:48,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar	dst=null	perm=null
2013-10-31 16:17:48,618 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49314, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1661306941, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8492324455653831791_1344, duration: 1307872
2013-10-31 16:17:48,728 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0029_m_-1440454458
2013-10-31 16:17:48,734 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28199 with signal TERM. Exit code 0
2013-10-31 16:17:48,734 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_407080348
2013-10-31 16:17:48,735 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_407080348 spawned.
2013-10-31 16:17:48,736 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000006_0/taskjvm.sh
2013-10-31 16:17:48,833 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0029_m_-1440454458
2013-10-31 16:17:49,447 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:49,447 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:49,447 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:49,448 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-1440454458 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:50,167 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_407080348 given task: attempt_20131031160444934_0030_m_000006_0
2013-10-31 16:17:50,527 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0029
2013-10-31 16:17:50,527 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000005_0 not found in cache
2013-10-31 16:17:50,527 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000001_0 not found in cache
2013-10-31 16:17:50,527 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000000_0 not found in cache
2013-10-31 16:17:50,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0029 for user-log deletion with retainTimeStamp:1383322670528
2013-10-31 16:17:50,566 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0029
2013-10-31 16:17:50,567 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000003_0 not found in cache
2013-10-31 16:17:50,567 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000002_0 not found in cache
2013-10-31 16:17:50,567 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0029 for user-log deletion with retainTimeStamp:1383322670567
2013-10-31 16:17:50,639 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0029
2013-10-31 16:17:50,639 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000004_0 not found in cache
2013-10-31 16:17:50,639 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0029 for user-log deletion with retainTimeStamp:1383322670639
2013-10-31 16:17:50,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:50,757 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0029_m_-1171757031 since job job_20131031160444934_0029 is dead
2013-10-31 16:17:50,767 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28381 with signal TERM. Exit code 0
2013-10-31 16:17:50,885 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-8492324455653831791_1344 to 127.0.0.1:50942 
2013-10-31 16:17:50,886 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1641886665873571422_1337 file build/test/data/dfs/data/data1/current/blk_-1641886665873571422 for deletion
2013-10-31 16:17:50,886 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1641886665873571422_1337 at file build/test/data/dfs/data/data1/current/blk_-1641886665873571422
2013-10-31 16:17:50,887 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8492324455653831791_1344 src: /127.0.0.1:36215 dest: /127.0.0.1:50942
2013-10-31 16:17:50,887 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-8492324455653831791_1344 to /127.0.0.1:50942
2013-10-31 16:17:50,891 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8492324455653831791_1344 src: /127.0.0.1:36215 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:17:50,896 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8492324455653831791_1344 size 238055
2013-10-31 16:17:50,951 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:50,951 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:50,951 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:50,951 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-1171757031 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:51,331 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-1641886665873571422_1337
2013-10-31 16:17:51,509 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0029_m_-1587966514 since job job_20131031160444934_0029 is dead
2013-10-31 16:17:51,520 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28300 with signal TERM. Exit code 0
2013-10-31 16:17:51,631 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0029_m_-90922477 since job job_20131031160444934_0029 is dead
2013-10-31 16:17:51,642 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28062 with signal TERM. Exit code 0
2013-10-31 16:17:51,697 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:51,697 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:51,697 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:51,697 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-1587966514 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:51,718 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0029_m_-1214579449 since job job_20131031160444934_0029 is dead
2013-10-31 16:17:51,723 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28346 with signal TERM. Exit code 0
2013-10-31 16:17:51,807 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:51,808 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:51,808 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:51,808 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-90922477 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:17:51,908 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:51,908 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:51,908 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:17:51,908 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-1214579449 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:52,097 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1641886665873571422_1337 file build/test/data/dfs/data/data6/current/blk_-1641886665873571422 for deletion
2013-10-31 16:17:52,098 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1641886665873571422_1337 at file build/test/data/dfs/data/data6/current/blk_-1641886665873571422
2013-10-31 16:17:53,608 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000006_0 0.0% setup
2013-10-31 16:17:53,611 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000006_0 is done.
2013-10-31 16:17:53,611 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000006_0  was -1
2013-10-31 16:17:53,612 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:54,545 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000006_0' has completed task_20131031160444934_0030_m_000006 successfully.
2013-10-31 16:17:54,700 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000000_0' to tip task_20131031160444934_0030_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:54,702 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000000
2013-10-31 16:17:54,702 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000001_0' to tip task_20131031160444934_0030_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:54,703 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000001
2013-10-31 16:17:54,704 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000002_0' to tip task_20131031160444934_0030_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:17:54,706 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:17:54,706 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000002
2013-10-31 16:17:54,707 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:17:54,707 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000003_0' to tip task_20131031160444934_0030_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:17:54,707 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000000_0 which needs 1 slots
2013-10-31 16:17:54,707 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000000_0 which needs 1 slots
2013-10-31 16:17:54,707 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000003
2013-10-31 16:17:54,708 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000001_0 which needs 1 slots
2013-10-31 16:17:54,708 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0030_m_000001_0 which needs 1 slots
2013-10-31 16:17:54,710 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000004_0' to tip task_20131031160444934_0030_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:17:54,710 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000004
2013-10-31 16:17:54,712 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:17:54,714 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:17:54,718 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:17:54,718 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000002_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000004_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000002_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000004_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000003_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0030_m_000003_0 which needs 1 slots
2013-10-31 16:17:54,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken	dst=null	perm=null
2013-10-31 16:17:54,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken	dst=null	perm=null
2013-10-31 16:17:54,843 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_357915176
2013-10-31 16:17:54,845 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_357915176 spawned.
2013-10-31 16:17:54,846 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0030/attempt_20131031160444934_0030_m_000001_0. Attempting to reuse: jvm_20131031160444934_0030_m_407080348
2013-10-31 16:17:54,847 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49319, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5985565395941547146_1350, duration: 1166246
2013-10-31 16:17:54,849 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000000_0/taskjvm.sh
2013-10-31 16:17:54,849 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49320, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5985565395941547146_1350, duration: 273662
2013-10-31 16:17:54,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml	dst=null	perm=null
2013-10-31 16:17:54,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml	dst=null	perm=null
2013-10-31 16:17:54,860 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36290, bytes: 28935, op: HDFS_READ, cliID: DFSClient_-1195420231, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8878127457679220121_1347, duration: 401068
2013-10-31 16:17:54,860 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36291, bytes: 28935, op: HDFS_READ, cliID: DFSClient_-517762114, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8878127457679220121_1347, duration: 443510
2013-10-31 16:17:54,888 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:54,892 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:54,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar	dst=null	perm=null
2013-10-31 16:17:54,906 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56328, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1195420231, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8492324455653831791_1344, duration: 618319
2013-10-31 16:17:54,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar	dst=null	perm=null
2013-10-31 16:17:54,916 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36293, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-517762114, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8492324455653831791_1344, duration: 619822
2013-10-31 16:17:54,962 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_767723640
2013-10-31 16:17:54,963 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_767723640 spawned.
2013-10-31 16:17:54,964 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000002_0/taskjvm.sh
2013-10-31 16:17:54,965 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_1871656188
2013-10-31 16:17:54,966 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_1871656188 spawned.
2013-10-31 16:17:54,968 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000003_0/taskjvm.sh
2013-10-31 16:17:54,974 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_-469071112
2013-10-31 16:17:54,974 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_-469071112 spawned.
2013-10-31 16:17:54,976 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000004_0/taskjvm.sh
2013-10-31 16:17:55,174 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_407080348 given task: attempt_20131031160444934_0030_m_000001_0
2013-10-31 16:17:55,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split	dst=null	perm=null
2013-10-31 16:17:55,283 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56331, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1824606275897357057_1345, duration: 167727
2013-10-31 16:17:55,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:17:55,327 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49329, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 291181
2013-10-31 16:17:55,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:55,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:55,669 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_357915176 given task: attempt_20131031160444934_0030_m_000000_0
2013-10-31 16:17:55,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=null
2013-10-31 16:17:55,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:55,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:55,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:55,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:55,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:55,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:55,876 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56334, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1663768746748666765_1339, duration: 129942
2013-10-31 16:17:55,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:55,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56335, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7018752213662655129_1339, duration: 131934
2013-10-31 16:17:55,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:55,896 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36231, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4668368595109805817_1342, duration: 97867
2013-10-31 16:17:55,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:55,900 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36301, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6018207326177541389_1341, duration: 124272
2013-10-31 16:17:55,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:55,903 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36233, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1513594355081957583_1342, duration: 111321
2013-10-31 16:17:55,912 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001. blk_-167795708726022168_1351
2013-10-31 16:17:55,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-167795708726022168_1351 src: /127.0.0.1:49336 dest: /127.0.0.1:47311
2013-10-31 16:17:55,929 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-167795708726022168_1351 src: /127.0.0.1:56340 dest: /127.0.0.1:41648
2013-10-31 16:17:55,929 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-167795708726022168_1351 src: /127.0.0.1:36305 dest: /127.0.0.1:38271
2013-10-31 16:17:55,933 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36305, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-167795708726022168_1351, duration: 1633305
2013-10-31 16:17:55,933 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-167795708726022168_1351 terminating
2013-10-31 16:17:55,933 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56340, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-167795708726022168_1351, duration: 454847
2013-10-31 16:17:55,933 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-167795708726022168_1351 terminating
2013-10-31 16:17:55,933 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49336, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-167795708726022168_1351, duration: 780365
2013-10-31 16:17:55,933 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-167795708726022168_1351 terminating
2013-10-31 16:17:55,934 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-167795708726022168_1351 size 12
2013-10-31 16:17:55,935 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-167795708726022168_1351 size 12
2013-10-31 16:17:55,935 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-167795708726022168_1351 size 12
2013-10-31 16:17:55,935 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0030_m_000001_0
2013-10-31 16:17:55,936 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0030_m_000001_0
2013-10-31 16:17:55,975 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:55,975 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000001_0 0.0% 
2013-10-31 16:17:56,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split	dst=null	perm=null
2013-10-31 16:17:56,197 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36238, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1824606275897357057_1345, duration: 169417
2013-10-31 16:17:56,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:17:56,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:56,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:56,432 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_767723640 given task: attempt_20131031160444934_0030_m_000002_0
2013-10-31 16:17:56,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=null
2013-10-31 16:17:56,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:56,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:56,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:56,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:56,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:56,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:56,482 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49344, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1663768746748666765_1339, duration: 135391
2013-10-31 16:17:56,489 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_1871656188 given task: attempt_20131031160444934_0030_m_000003_0
2013-10-31 16:17:56,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:56,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49345, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7018752213662655129_1339, duration: 124593
2013-10-31 16:17:56,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:56,502 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56349, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 100064
2013-10-31 16:17:56,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:56,505 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49347, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6018207326177541389_1341, duration: 103426
2013-10-31 16:17:56,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:56,508 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36315, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1513594355081957583_1342, duration: 99842
2013-10-31 16:17:56,511 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49349, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 99964
2013-10-31 16:17:56,518 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000. blk_-1312997292511735196_1352
2013-10-31 16:17:56,545 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1312997292511735196_1352 src: /127.0.0.1:49350 dest: /127.0.0.1:47311
2013-10-31 16:17:56,546 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1312997292511735196_1352 src: /127.0.0.1:56354 dest: /127.0.0.1:41648
2013-10-31 16:17:56,547 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1312997292511735196_1352 src: /127.0.0.1:36250 dest: /127.0.0.1:50942
2013-10-31 16:17:56,549 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36250, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1312997292511735196_1352, duration: 1152477
2013-10-31 16:17:56,550 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1312997292511735196_1352 terminating
2013-10-31 16:17:56,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56354, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1312997292511735196_1352, duration: 1486022
2013-10-31 16:17:56,550 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1312997292511735196_1352 terminating
2013-10-31 16:17:56,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49350, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1312997292511735196_1352, duration: 1848691
2013-10-31 16:17:56,550 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1312997292511735196_1352 terminating
2013-10-31 16:17:56,551 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_-469071112 given task: attempt_20131031160444934_0030_m_000004_0
2013-10-31 16:17:56,553 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1312997292511735196_1352 size 12
2013-10-31 16:17:56,554 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1312997292511735196_1352 size 12
2013-10-31 16:17:56,554 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1312997292511735196_1352 size 12
2013-10-31 16:17:56,904 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-167795708726022168_1351
2013-10-31 16:17:56,952 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0030_m_000000_0
2013-10-31 16:17:56,953 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0030_m_000000_0
2013-10-31 16:17:56,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split	dst=null	perm=null
2013-10-31 16:17:56,964 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36253, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1824606275897357057_1345, duration: 162664
2013-10-31 16:17:56,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split	dst=null	perm=null
2013-10-31 16:17:57,002 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36324, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1824606275897357057_1345, duration: 247582
2013-10-31 16:17:57,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:17:57,005 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:57,005 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000000_0 0.0% 
2013-10-31 16:17:57,007 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36256, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 196274
2013-10-31 16:17:57,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:57,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:57,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:17:57,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49359, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 121610
2013-10-31 16:17:57,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split	dst=null	perm=null
2013-10-31 16:17:57,059 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56363, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1824606275897357057_1345, duration: 150417
2013-10-31 16:17:57,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:17:57,115 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36259, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 137314
2013-10-31 16:17:57,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=null
2013-10-31 16:17:57,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:57,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:57,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:57,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:57,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:57,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:57,374 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49362, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1663768746748666765_1339, duration: 287311
2013-10-31 16:17:57,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:57,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:57,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:57,391 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36330, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7018752213662655129_1339, duration: 125286
2013-10-31 16:17:57,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:57,394 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56367, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 103694
2013-10-31 16:17:57,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:57,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:57,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36332, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6018207326177541389_1341, duration: 101225
2013-10-31 16:17:57,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:57,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:57,401 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36264, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1513594355081957583_1342, duration: 266254
2013-10-31 16:17:57,411 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002. blk_669744094790171250_1355
2013-10-31 16:17:57,441 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_669744094790171250_1355 src: /127.0.0.1:36265 dest: /127.0.0.1:50942
2013-10-31 16:17:57,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_669744094790171250_1355 src: /127.0.0.1:56371 dest: /127.0.0.1:41648
2013-10-31 16:17:57,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_669744094790171250_1355 src: /127.0.0.1:49369 dest: /127.0.0.1:47311
2013-10-31 16:17:57,444 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49369, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_669744094790171250_1355, duration: 1058907
2013-10-31 16:17:57,445 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_669744094790171250_1355 terminating
2013-10-31 16:17:57,445 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_669744094790171250_1355 size 12
2013-10-31 16:17:57,445 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56371, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_669744094790171250_1355, duration: 1422366
2013-10-31 16:17:57,445 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_669744094790171250_1355 terminating
2013-10-31 16:17:57,445 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36265, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_669744094790171250_1355, duration: 1924515
2013-10-31 16:17:57,446 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_669744094790171250_1355 terminating
2013-10-31 16:17:57,446 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0030_m_000002_0
2013-10-31 16:17:57,447 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0030_m_000002_0
2013-10-31 16:17:57,447 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_669744094790171250_1355 size 12
2013-10-31 16:17:57,449 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_669744094790171250_1355 size 12
2013-10-31 16:17:57,493 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:57,493 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000002_0 0.0% 
2013-10-31 16:17:57,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=null
2013-10-31 16:17:57,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:57,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:57,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:57,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:57,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:57,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:57,623 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56373, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1663768746748666765_1339, duration: 160292
2013-10-31 16:17:57,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=null
2013-10-31 16:17:57,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:57,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:57,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:57,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:57,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:57,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:57,640 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36338, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7018752213662655129_1339, duration: 105310
2013-10-31 16:17:57,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:57,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000	dst=null	perm=null
2013-10-31 16:17:57,644 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56375, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 101836
2013-10-31 16:17:57,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:57,647 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49373, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6018207326177541389_1341, duration: 109569
2013-10-31 16:17:57,648 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49374, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1663768746748666765_1339, duration: 117370
2013-10-31 16:17:57,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:57,651 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36273, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1513594355081957583_1342, duration: 103499
2013-10-31 16:17:57,659 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004. blk_7061817477599287647_1355
2013-10-31 16:17:57,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001	dst=null	perm=null
2013-10-31 16:17:57,666 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49377, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7018752213662655129_1339, duration: 116217
2013-10-31 16:17:57,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002	dst=null	perm=null
2013-10-31 16:17:57,669 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56381, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 114922
2013-10-31 16:17:57,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003	dst=null	perm=null
2013-10-31 16:17:57,672 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36277, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6018207326177541389_1341, duration: 114866
2013-10-31 16:17:57,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004	dst=null	perm=null
2013-10-31 16:17:57,675 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36347, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1513594355081957583_1342, duration: 115849
2013-10-31 16:17:57,682 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7061817477599287647_1355 src: /127.0.0.1:49376 dest: /127.0.0.1:47311
2013-10-31 16:17:57,683 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7061817477599287647_1355 src: /127.0.0.1:36348 dest: /127.0.0.1:38271
2013-10-31 16:17:57,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7061817477599287647_1355 src: /127.0.0.1:36280 dest: /127.0.0.1:50942
2013-10-31 16:17:57,686 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003. blk_3963998881078876696_1355
2013-10-31 16:17:57,688 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36280, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7061817477599287647_1355, duration: 2014793
2013-10-31 16:17:57,689 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7061817477599287647_1355 terminating
2013-10-31 16:17:57,689 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36348, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7061817477599287647_1355, duration: 3595218
2013-10-31 16:17:57,691 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7061817477599287647_1355 terminating
2013-10-31 16:17:57,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49376, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7061817477599287647_1355, duration: 5744391
2013-10-31 16:17:57,692 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7061817477599287647_1355 terminating
2013-10-31 16:17:57,692 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7061817477599287647_1355 size 12
2013-10-31 16:17:57,693 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0030_m_000004_0
2013-10-31 16:17:57,694 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0030_m_000004_0
2013-10-31 16:17:57,694 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7061817477599287647_1355 size 12
2013-10-31 16:17:57,695 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7061817477599287647_1355 size 12
2013-10-31 16:17:57,709 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3963998881078876696_1355 src: /127.0.0.1:36350 dest: /127.0.0.1:38271
2013-10-31 16:17:57,710 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3963998881078876696_1355 src: /127.0.0.1:56387 dest: /127.0.0.1:41648
2013-10-31 16:17:57,710 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000000_0
2013-10-31 16:17:57,710 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000001_0
2013-10-31 16:17:57,711 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3963998881078876696_1355 src: /127.0.0.1:49385 dest: /127.0.0.1:47311
2013-10-31 16:17:57,713 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000002_0
2013-10-31 16:17:57,713 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49385, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3963998881078876696_1355, duration: 855662
2013-10-31 16:17:57,714 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3963998881078876696_1355 terminating
2013-10-31 16:17:57,714 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56387, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3963998881078876696_1355, duration: 1624032
2013-10-31 16:17:57,715 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3963998881078876696_1355 size 12
2013-10-31 16:17:57,715 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3963998881078876696_1355 terminating
2013-10-31 16:17:57,715 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36350, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3963998881078876696_1355, duration: 2713840
2013-10-31 16:17:57,716 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3963998881078876696_1355 size 12
2013-10-31 16:17:57,716 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3963998881078876696_1355 terminating
2013-10-31 16:17:57,717 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0030_m_000003_0
2013-10-31 16:17:57,718 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0030_m_000003_0
2013-10-31 16:17:57,718 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3963998881078876696_1355 size 12
2013-10-31 16:17:57,758 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:57,758 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000004_0 0.0% 
2013-10-31 16:17:57,765 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:57,766 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000003_0 0.0% 
2013-10-31 16:17:57,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0	dst=null	perm=null
2013-10-31 16:17:57,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:57,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:58,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0	dst=null	perm=null
2013-10-31 16:17:58,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0	dst=null	perm=null
2013-10-31 16:17:58,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:58,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:58,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0	dst=null	perm=null
2013-10-31 16:17:58,243 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:17:58,245 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000001_0 is done.
2013-10-31 16:17:58,245 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000001_0  was -1
2013-10-31 16:17:58,246 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:58,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0	dst=null	perm=null
2013-10-31 16:17:58,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:58,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:58,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0	dst=null	perm=null
2013-10-31 16:17:59,123 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:17:59,125 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000000_0 is done.
2013-10-31 16:17:59,125 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000000_0  was -1
2013-10-31 16:17:59,125 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:59,707 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0030_m_000006_0
2013-10-31 16:17:59,708 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0030_m_000006_0
2013-10-31 16:17:59,708 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000006_0 not found in cache
2013-10-31 16:17:59,885 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:17:59,887 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000002_0 is done.
2013-10-31 16:17:59,887 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000002_0  was -1
2013-10-31 16:17:59,888 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:00,716 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000000_0' has completed task_20131031160444934_0030_m_000000 successfully.
2013-10-31 16:18:00,717 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000001_0' has completed task_20131031160444934_0030_m_000001 successfully.
2013-10-31 16:18:00,720 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000002_0' has completed task_20131031160444934_0030_m_000002 successfully.
2013-10-31 16:18:00,722 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000003_0
2013-10-31 16:18:00,723 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000004_0
2013-10-31 16:18:00,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0	dst=null	perm=null
2013-10-31 16:18:00,770 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1895 Total time for transactions(ms): 41Number of transactions batched in Syncs: 211 Number of syncs: 1357 SyncTimes(ms): 63303 13233 
2013-10-31 16:18:00,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:00,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0	dst=null	perm=null
2013-10-31 16:18:00,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:00,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:00,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0	dst=null	perm=null
2013-10-31 16:18:01,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:01,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0	dst=null	perm=null
2013-10-31 16:18:02,999 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:18:03,007 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:18:03,008 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000003_0 is done.
2013-10-31 16:18:03,008 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000003_0  was -1
2013-10-31 16:18:03,008 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:03,034 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:18:03,040 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:18:03,041 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000004_0 is done.
2013-10-31 16:18:03,041 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000004_0  was -1
2013-10-31 16:18:03,041 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:03,726 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000003_0' has completed task_20131031160444934_0030_m_000003 successfully.
2013-10-31 16:18:03,728 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000004_0' has completed task_20131031160444934_0030_m_000004 successfully.
2013-10-31 16:18:03,731 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0030_m_000005_0' to tip task_20131031160444934_0030_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:18:03,733 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:18:03,734 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000005_0 which needs 1 slots
2013-10-31 16:18:03,734 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000005_0 which needs 1 slots
2013-10-31 16:18:03,767 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_-1035919601
2013-10-31 16:18:03,768 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_-1035919601 spawned.
2013-10-31 16:18:03,769 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000005_0/taskjvm.sh
2013-10-31 16:18:04,799 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_-1035919601 given task: attempt_20131031160444934_0030_m_000005_0
2013-10-31 16:18:05,315 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000005_0 0.0% 
2013-10-31 16:18:05,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary	dst=null	perm=null
2013-10-31 16:18:05,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:05,344 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS from client DFSClient_attempt_20131031160444934_0030_m_000005_0
2013-10-31 16:18:05,344 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0030_m_000005_0
2013-10-31 16:18:05,352 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8492324455653831791 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:05,352 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8492324455653831791 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:05,352 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8492324455653831791 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:05,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8492324455653831791 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:05,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1824606275897357057 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:05,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1824606275897357057 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:05,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1824606275897357057 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:05,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1824606275897357057 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:05,353 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6914640943678526682 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:05,354 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6914640943678526682 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:05,354 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6914640943678526682 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:05,354 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8878127457679220121 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:05,354 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8878127457679220121 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:05,354 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8878127457679220121 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:05,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030	dst=null	perm=null
2013-10-31 16:18:05,457 INFO  mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031160444934_0030_m_000005_0 is 1726 ms debug.
2013-10-31 16:18:06,333 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-8878127457679220121_1347 blk_-6914640943678526682_1346 blk_-8492324455653831791_1344 blk_1824606275897357057_1345
2013-10-31 16:18:06,334 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-8878127457679220121_1347 blk_-6914640943678526682_1346 blk_-8492324455653831791_1344 blk_1824606275897357057_1345
2013-10-31 16:18:07,103 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8878127457679220121_1347 file build/test/data/dfs/data/data6/current/blk_-8878127457679220121 for deletion
2013-10-31 16:18:07,103 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8492324455653831791_1344 file build/test/data/dfs/data/data5/current/blk_-8492324455653831791 for deletion
2013-10-31 16:18:07,103 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8878127457679220121_1347 at file build/test/data/dfs/data/data6/current/blk_-8878127457679220121
2013-10-31 16:18:07,103 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6914640943678526682_1346 file build/test/data/dfs/data/data5/current/blk_-6914640943678526682 for deletion
2013-10-31 16:18:07,104 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8492324455653831791_1344 at file build/test/data/dfs/data/data5/current/blk_-8492324455653831791
2013-10-31 16:18:07,104 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1824606275897357057_1345 file build/test/data/dfs/data/data6/current/blk_1824606275897357057 for deletion
2013-10-31 16:18:07,104 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6914640943678526682_1346 at file build/test/data/dfs/data/data5/current/blk_-6914640943678526682
2013-10-31 16:18:07,105 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1824606275897357057_1345 at file build/test/data/dfs/data/data6/current/blk_1824606275897357057
2013-10-31 16:18:08,225 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000005_0 0.0% cleanup
2013-10-31 16:18:08,227 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000005_0 is done.
2013-10-31 16:18:08,227 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000005_0  was -1
2013-10-31 16:18:08,228 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:09,101 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8878127457679220121_1347 file build/test/data/dfs/data/data8/current/blk_-8878127457679220121 for deletion
2013-10-31 16:18:09,101 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8492324455653831791_1344 file build/test/data/dfs/data/data7/current/blk_-8492324455653831791 for deletion
2013-10-31 16:18:09,102 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6914640943678526682_1346 file build/test/data/dfs/data/data7/current/blk_-6914640943678526682 for deletion
2013-10-31 16:18:09,102 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1824606275897357057_1345 file build/test/data/dfs/data/data8/current/blk_1824606275897357057 for deletion
2013-10-31 16:18:09,204 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8878127457679220121_1347 at file build/test/data/dfs/data/data8/current/blk_-8878127457679220121
2013-10-31 16:18:09,204 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1824606275897357057_1345 at file build/test/data/dfs/data/data8/current/blk_1824606275897357057
2013-10-31 16:18:09,252 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8492324455653831791_1344 at file build/test/data/dfs/data/data7/current/blk_-8492324455653831791
2013-10-31 16:18:09,252 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6914640943678526682_1346 at file build/test/data/dfs/data/data7/current/blk_-6914640943678526682
2013-10-31 16:18:09,334 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-8492324455653831791_1344 blk_1824606275897357057_1345
2013-10-31 16:18:09,335 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-8878127457679220121_1347 blk_-6914640943678526682_1346 blk_-8492324455653831791_1344 blk_1824606275897357057_1345
2013-10-31 16:18:09,490 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8492324455653831791_1344 file build/test/data/dfs/data/data3/current/blk_-8492324455653831791 for deletion
2013-10-31 16:18:09,491 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1824606275897357057_1345 file build/test/data/dfs/data/data4/current/blk_1824606275897357057 for deletion
2013-10-31 16:18:09,491 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1824606275897357057_1345 at file build/test/data/dfs/data/data4/current/blk_1824606275897357057
2013-10-31 16:18:09,491 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8492324455653831791_1344 at file build/test/data/dfs/data/data3/current/blk_-8492324455653831791
2013-10-31 16:18:09,741 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000005_0' has completed task_20131031160444934_0030_m_000005 successfully.
2013-10-31 16:18:09,742 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0030 has completed successfully.
2013-10-31 16:18:09,742 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0030,submitTime=1383236265737,launchTime=1383236267333,firstMapTaskLaunchTime=1383236274700,firstJobSetupTaskLaunchTime=1383236268531,firstJobCleanupTaskLaunchTime=1383236283731,finishTime=1383236289742,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E4EC0E4BA2CD4E49B23EC80C191F27BB/4AD809DC610A4252ACDCE6246E6419AA] lower*upper1*upper2/(1/3) ...rm/joinsamesourceintojoin
2013-10-31 16:18:09,747 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252. blk_-2846812765736743198_1356
2013-10-31 16:18:09,753 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2846812765736743198_1356 src: /127.0.0.1:49390 dest: /127.0.0.1:47311
2013-10-31 16:18:09,755 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2846812765736743198_1356 src: /127.0.0.1:36358 dest: /127.0.0.1:38271
2013-10-31 16:18:09,757 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2846812765736743198_1356 src: /127.0.0.1:36290 dest: /127.0.0.1:50942
2013-10-31 16:18:09,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36290, dest: /127.0.0.1:50942, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2846812765736743198_1356, duration: 5380603
2013-10-31 16:18:09,768 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2846812765736743198_1356 terminating
2013-10-31 16:18:09,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36358, dest: /127.0.0.1:38271, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2846812765736743198_1356, duration: 3632868
2013-10-31 16:18:09,769 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2846812765736743198_1356 terminating
2013-10-31 16:18:09,769 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49390, dest: /127.0.0.1:47311, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2846812765736743198_1356, duration: 6255838
2013-10-31 16:18:09,770 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2846812765736743198_1356 terminating
2013-10-31 16:18:09,775 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2846812765736743198_1356 size 26369
2013-10-31 16:18:09,775 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252 from client DFSClient_695084204
2013-10-31 16:18:09,776 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252 is closed by DFSClient_695084204
2013-10-31 16:18:09,776 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2846812765736743198_1356 size 26369
2013-10-31 16:18:09,776 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2846812765736743198_1356 size 26369
2013-10-31 16:18:09,784 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:18:09,785 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000004_0'
2013-10-31 16:18:09,785 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000005_0'
2013-10-31 16:18:09,786 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5985565395941547146 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,787 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5985565395941547146 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,787 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5985565395941547146 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,791 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0030_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:18:09,793 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2852820014732100186 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,794 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2852820014732100186 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,794 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2852820014732100186 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,794 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5935025676836584846 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,794 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5935025676836584846 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,795 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5935025676836584846 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,795 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_715915181680467880 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,795 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_715915181680467880 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,795 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_715915181680467880 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,795 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4468907177856788027 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,796 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4468907177856788027 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,796 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4468907177856788027 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030	dst=null	perm=null
2013-10-31 16:18:09,796 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777050699776076643 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,796 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777050699776076643 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777050699776076643 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8577440969405303007 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8577440969405303007 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8577440969405303007 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,798 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5223740880924984010 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,798 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5223740880924984010 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,798 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5223740880924984010 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91	dst=null	perm=null
2013-10-31 16:18:09,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4844518074889198090 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4844518074889198090 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4844518074889198090 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7470160298863947644 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7470160298863947644 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7470160298863947644 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1663768746748666765 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,807 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1663768746748666765 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,807 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1663768746748666765 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,807 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7018752213662655129 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,807 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7018752213662655129 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,807 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7018752213662655129 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,808 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4668368595109805817 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,808 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4668368595109805817 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,808 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4668368595109805817 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,808 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6018207326177541389 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,809 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6018207326177541389 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,809 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6018207326177541389 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,809 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1513594355081957583 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,809 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1513594355081957583 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,809 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1513594355081957583 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68	dst=null	perm=null
2013-10-31 16:18:09,816 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary
2013-10-31 16:18:09,823 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0030
2013-10-31 16:18:09,823 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0030 being deleted.
2013-10-31 16:18:09,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2013-10-31 16:18:09,826 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:18:09,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2013-10-31 16:18:09,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2013-10-31 16:18:09,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2013-10-31 16:18:09,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2013-10-31 16:18:09,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2013-10-31 16:18:09,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2013-10-31 16:18:09,834 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49394, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1312997292511735196_1352, duration: 297295
2013-10-31 16:18:09,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2013-10-31 16:18:09,836 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36362, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-167795708726022168_1351, duration: 267509
2013-10-31 16:18:09,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2013-10-31 16:18:09,839 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56399, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_669744094790171250_1355, duration: 317284
2013-10-31 16:18:09,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2013-10-31 16:18:09,841 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56400, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3963998881078876696_1355, duration: 292146
2013-10-31 16:18:09,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2013-10-31 16:18:09,843 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36365, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7061817477599287647_1355, duration: 262997
2013-10-31 16:18:09,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2013-10-31 16:18:09,859 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:18:09,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2013-10-31 16:18:09,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2013-10-31 16:18:09,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2013-10-31 16:18:09,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2013-10-31 16:18:09,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2013-10-31 16:18:09,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2013-10-31 16:18:09,869 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56402, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1312997292511735196_1352, duration: 390643
2013-10-31 16:18:09,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2013-10-31 16:18:09,872 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49400, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-167795708726022168_1351, duration: 250549
2013-10-31 16:18:09,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2013-10-31 16:18:09,875 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36299, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_669744094790171250_1355, duration: 265556
2013-10-31 16:18:09,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2013-10-31 16:18:09,879 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36369, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3963998881078876696_1355, duration: 290957
2013-10-31 16:18:09,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2013-10-31 16:18:09,882 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36301, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7061817477599287647_1355, duration: 254606
2013-10-31 16:18:09,882 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsamesourceintojoin
2013-10-31 16:18:09,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2013-10-31 16:18:09,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2013-10-31 16:18:09,890 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49404, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1312997292511735196_1352, duration: 257589
2013-10-31 16:18:09,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2013-10-31 16:18:09,894 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56408, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-167795708726022168_1351, duration: 292495
2013-10-31 16:18:09,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2013-10-31 16:18:09,899 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49406, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_669744094790171250_1355, duration: 285544
2013-10-31 16:18:09,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2013-10-31 16:18:09,903 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36374, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3963998881078876696_1355, duration: 255566
2013-10-31 16:18:09,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2013-10-31 16:18:09,907 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36375, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7061817477599287647_1355, duration: 254565
2013-10-31 16:18:09,931 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:18:09,932 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:18:09,959 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting
2013-10-31 16:18:09,959 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:18:09,959 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:18:09,960 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:18:09,960 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:18:09,960 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup"]
2013-10-31 16:18:09,961 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  parallel execution is enabled: true
2013-10-31 16:18:09,961 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  starting jobs: 1
2013-10-31 16:18:09,961 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping]  allocating threads: 1
2013-10-31 16:18:09,962 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (1/1) ...platform/joinsintocogroup
2013-10-31 16:18:09,965 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:18:09,965 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:18:09,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:09,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:18:10,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:10,004 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar. blk_-2293510353387054922_1357
2013-10-31 16:18:10,005 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2293510353387054922_1357 src: /127.0.0.1:36307 dest: /127.0.0.1:50942
2013-10-31 16:18:10,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2293510353387054922_1357 src: /127.0.0.1:36377 dest: /127.0.0.1:38271
2013-10-31 16:18:10,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2293510353387054922_1357 src: /127.0.0.1:49411 dest: /127.0.0.1:47311
2013-10-31 16:18:10,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49411, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2293510353387054922_1357, duration: 6374989
2013-10-31 16:18:10,019 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2293510353387054922_1357 terminating
2013-10-31 16:18:10,019 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2293510353387054922_1357 size 238055
2013-10-31 16:18:10,019 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36377, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2293510353387054922_1357, duration: 7525244
2013-10-31 16:18:10,020 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2293510353387054922_1357 terminating
2013-10-31 16:18:10,020 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36307, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2293510353387054922_1357, duration: 8244406
2013-10-31 16:18:10,021 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2293510353387054922_1357 terminating
2013-10-31 16:18:10,022 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2293510353387054922_1357 size 238055
2013-10-31 16:18:10,023 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar from client DFSClient_1457307213
2013-10-31 16:18:10,023 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar is closed by DFSClient_1457307213
2013-10-31 16:18:10,024 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2293510353387054922_1357 size 238055
2013-10-31 16:18:10,030 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar. New replication is 10
2013-10-31 16:18:10,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar	dst=null	perm=null
2013-10-31 16:18:10,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:10,046 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:18:10,050 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:10,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:18:10,053 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:10,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:18:10,056 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:10,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:18:10,059 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:10,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:18:10,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:10,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:10,083 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split. New replication is 10
2013-10-31 16:18:10,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=null
2013-10-31 16:18:10,091 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split. blk_4889450459518297417_1358
2013-10-31 16:18:10,093 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4889450459518297417_1358 src: /127.0.0.1:49412 dest: /127.0.0.1:47311
2013-10-31 16:18:10,094 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4889450459518297417_1358 src: /127.0.0.1:36311 dest: /127.0.0.1:50942
2013-10-31 16:18:10,096 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4889450459518297417_1358 src: /127.0.0.1:56417 dest: /127.0.0.1:41648
2013-10-31 16:18:10,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4889450459518297417_1358 src: /127.0.0.1:36382 dest: /127.0.0.1:38271
2013-10-31 16:18:10,101 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36382, dest: /127.0.0.1:38271, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4889450459518297417_1358, duration: 114176
2013-10-31 16:18:10,101 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4889450459518297417_1358 terminating
2013-10-31 16:18:10,102 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56417, dest: /127.0.0.1:41648, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4889450459518297417_1358, duration: 886372
2013-10-31 16:18:10,102 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4889450459518297417_1358 terminating
2013-10-31 16:18:10,103 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36311, dest: /127.0.0.1:50942, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4889450459518297417_1358, duration: 1812337
2013-10-31 16:18:10,103 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4889450459518297417_1358 size 2073
2013-10-31 16:18:10,103 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4889450459518297417_1358 terminating
2013-10-31 16:18:10,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49412, dest: /127.0.0.1:47311, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 2776908
2013-10-31 16:18:10,104 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4889450459518297417_1358 terminating
2013-10-31 16:18:10,107 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4889450459518297417_1358 size 2073
2013-10-31 16:18:10,107 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split from client DFSClient_1457307213
2013-10-31 16:18:10,108 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split is closed by DFSClient_1457307213
2013-10-31 16:18:10,108 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4889450459518297417_1358 size 2073
2013-10-31 16:18:10,109 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4889450459518297417_1358 size 2073
2013-10-31 16:18:10,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,233 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo. blk_6095635965794745357_1359
2013-10-31 16:18:11,235 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6095635965794745357_1359 src: /127.0.0.1:49416 dest: /127.0.0.1:47311
2013-10-31 16:18:11,237 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6095635965794745357_1359 src: /127.0.0.1:36384 dest: /127.0.0.1:38271
2013-10-31 16:18:11,239 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6095635965794745357_1359 src: /127.0.0.1:36316 dest: /127.0.0.1:50942
2013-10-31 16:18:11,242 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36316, dest: /127.0.0.1:50942, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6095635965794745357_1359, duration: 72515
2013-10-31 16:18:11,242 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6095635965794745357_1359 terminating
2013-10-31 16:18:11,243 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36384, dest: /127.0.0.1:38271, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6095635965794745357_1359, duration: 928192
2013-10-31 16:18:11,243 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6095635965794745357_1359 terminating
2013-10-31 16:18:11,244 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6095635965794745357_1359 size 218
2013-10-31 16:18:11,244 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49416, dest: /127.0.0.1:47311, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6095635965794745357_1359, duration: 1927995
2013-10-31 16:18:11,244 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6095635965794745357_1359 terminating
2013-10-31 16:18:11,246 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6095635965794745357_1359 size 218
2013-10-31 16:18:11,247 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:18:11,247 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:18:11,247 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6095635965794745357_1359 size 218
2013-10-31 16:18:11,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,273 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml. blk_1855502406512099239_1360
2013-10-31 16:18:11,275 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1855502406512099239_1360 src: /127.0.0.1:36317 dest: /127.0.0.1:50942
2013-10-31 16:18:11,277 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1855502406512099239_1360 src: /127.0.0.1:49420 dest: /127.0.0.1:47311
2013-10-31 16:18:11,279 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1855502406512099239_1360 src: /127.0.0.1:56424 dest: /127.0.0.1:41648
2013-10-31 16:18:11,281 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56424, dest: /127.0.0.1:41648, bytes: 30268, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1855502406512099239_1360, duration: 257386
2013-10-31 16:18:11,282 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1855502406512099239_1360 terminating
2013-10-31 16:18:11,282 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49420, dest: /127.0.0.1:47311, bytes: 30268, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1855502406512099239_1360, duration: 1104809
2013-10-31 16:18:11,283 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1855502406512099239_1360 terminating
2013-10-31 16:18:11,283 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36317, dest: /127.0.0.1:50942, bytes: 30268, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1855502406512099239_1360, duration: 2063221
2013-10-31 16:18:11,284 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1855502406512099239_1360 terminating
2013-10-31 16:18:11,286 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1855502406512099239_1360 size 30268
2013-10-31 16:18:11,287 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml from client DFSClient_1457307213
2013-10-31 16:18:11,287 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml is closed by DFSClient_1457307213
2013-10-31 16:18:11,288 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1855502406512099239_1360 size 30268
2013-10-31 16:18:11,288 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1855502406512099239_1360 size 30268
2013-10-31 16:18:11,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml	dst=null	perm=null
2013-10-31 16:18:11,304 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56426, bytes: 30508, op: HDFS_READ, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1855502406512099239_1360, duration: 403430
2013-10-31 16:18:11,324 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0031: nMaps=6 nReduces=1 max=-1
2013-10-31 16:18:11,324 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0031 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:18:11,324 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0031
2013-10-31 16:18:11,324 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0031	RESULT=SUCCESS
2013-10-31 16:18:11,324 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0031
2013-10-31 16:18:11,325 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0031
2013-10-31 16:18:11,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,361 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_conf.xml. blk_32100703911106741_1362
2013-10-31 16:18:11,362 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_32100703911106741_1362 src: /127.0.0.1:49424 dest: /127.0.0.1:47311
2013-10-31 16:18:11,364 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_32100703911106741_1362 src: /127.0.0.1:36392 dest: /127.0.0.1:38271
2013-10-31 16:18:11,366 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_32100703911106741_1362 src: /127.0.0.1:36324 dest: /127.0.0.1:50942
2013-10-31 16:18:11,370 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36324, dest: /127.0.0.1:50942, bytes: 30333, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_32100703911106741_1362, duration: 534062
2013-10-31 16:18:11,370 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_32100703911106741_1362 terminating
2013-10-31 16:18:11,371 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36392, dest: /127.0.0.1:38271, bytes: 30333, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_32100703911106741_1362, duration: 1985217
2013-10-31 16:18:11,371 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_32100703911106741_1362 terminating
2013-10-31 16:18:11,371 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49424, dest: /127.0.0.1:47311, bytes: 30333, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_32100703911106741_1362, duration: 2469968
2013-10-31 16:18:11,372 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_32100703911106741_1362 terminating
2013-10-31 16:18:11,375 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_32100703911106741_1362 size 30333
2013-10-31 16:18:11,375 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_conf.xml from client DFSClient_-290827983
2013-10-31 16:18:11,375 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_conf.xml is closed by DFSClient_-290827983
2013-10-31 16:18:11,376 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_32100703911106741_1362 size 30333
2013-10-31 16:18:11,376 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_32100703911106741_1362 size 30333
2013-10-31 16:18:11,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,394 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken. blk_-4541719979601510441_1363
2013-10-31 16:18:11,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4541719979601510441_1363 src: /127.0.0.1:49427 dest: /127.0.0.1:47311
2013-10-31 16:18:11,397 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4541719979601510441_1363 src: /127.0.0.1:36326 dest: /127.0.0.1:50942
2013-10-31 16:18:11,398 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4541719979601510441_1363 src: /127.0.0.1:36396 dest: /127.0.0.1:38271
2013-10-31 16:18:11,401 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36396, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4541719979601510441_1363, duration: 83050
2013-10-31 16:18:11,402 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4541719979601510441_1363 terminating
2013-10-31 16:18:11,402 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36326, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4541719979601510441_1363, duration: 928016
2013-10-31 16:18:11,403 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4541719979601510441_1363 terminating
2013-10-31 16:18:11,403 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49427, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4541719979601510441_1363, duration: 1974047
2013-10-31 16:18:11,404 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4541719979601510441_1363 terminating
2013-10-31 16:18:11,407 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4541719979601510441_1363 size 116
2013-10-31 16:18:11,407 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4541719979601510441_1363 size 116
2013-10-31 16:18:11,408 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken from client DFSClient_1457307213
2013-10-31 16:18:11,408 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken is closed by DFSClient_1457307213
2013-10-31 16:18:11,408 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4541719979601510441_1363 size 116
2013-10-31 16:18:11,415 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken
2013-10-31 16:18:11,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:18:11,419 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36328, bytes: 222, op: HDFS_READ, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6095635965794745357_1359, duration: 360010
2013-10-31 16:18:11,420 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0031 = 71. Number of splits = 6
2013-10-31 16:18:11,420 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,421 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,421 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,421 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,421 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,422 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,422 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,422 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,422 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,425 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0031 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:18:11,425 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0031 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 16:18:11,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8878127457679220121_1347 file build/test/data/dfs/data/data1/current/blk_-8878127457679220121 for deletion
2013-10-31 16:18:11,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8492324455653831791_1344 file build/test/data/dfs/data/data2/current/blk_-8492324455653831791 for deletion
2013-10-31 16:18:11,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8878127457679220121_1347 at file build/test/data/dfs/data/data1/current/blk_-8878127457679220121
2013-10-31 16:18:11,892 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6914640943678526682_1346 file build/test/data/dfs/data/data2/current/blk_-6914640943678526682 for deletion
2013-10-31 16:18:11,893 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8492324455653831791_1344 at file build/test/data/dfs/data/data2/current/blk_-8492324455653831791
2013-10-31 16:18:11,893 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1824606275897357057_1345 file build/test/data/dfs/data/data1/current/blk_1824606275897357057 for deletion
2013-10-31 16:18:11,893 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6914640943678526682_1346 at file build/test/data/dfs/data/data2/current/blk_-6914640943678526682
2013-10-31 16:18:11,893 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1824606275897357057_1345 at file build/test/data/dfs/data/data1/current/blk_1824606275897357057
2013-10-31 16:18:12,336 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-2293510353387054922_1357 to datanode(s) 127.0.0.1:41648
2013-10-31 16:18:12,336 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_7470160298863947644_1336 blk_7018752213662655129_1339 blk_777050699776076643_1329 blk_4468907177856788027_1325 blk_5935025676836584846_1323 blk_-1663768746748666765_1339 blk_-4668368595109805817_1342 blk_-4844518074889198090_1343
2013-10-31 16:18:12,336 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_7470160298863947644_1336 blk_-1513594355081957583_1342 blk_777050699776076643_1329 blk_7018752213662655129_1339 blk_4468907177856788027_1325 blk_5935025676836584846_1323 blk_-5985565395941547146_1350 blk_-1663768746748666765_1339 blk_2852820014732100186_1330 blk_715915181680467880_1326 blk_8577440969405303007_1329 blk_-4668368595109805817_1342 blk_6018207326177541389_1341 blk_5223740880924984010_1329 blk_-4844518074889198090_1343
2013-10-31 16:18:12,492 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5985565395941547146_1350 file build/test/data/dfs/data/data3/current/blk_-5985565395941547146 for deletion
2013-10-31 16:18:12,492 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4844518074889198090_1343 file build/test/data/dfs/data/data4/current/blk_-4844518074889198090 for deletion
2013-10-31 16:18:12,492 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5985565395941547146_1350 at file build/test/data/dfs/data/data3/current/blk_-5985565395941547146
2013-10-31 16:18:12,494 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4844518074889198090_1343 at file build/test/data/dfs/data/data4/current/blk_-4844518074889198090
2013-10-31 16:18:12,494 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4668368595109805817_1342 file build/test/data/dfs/data/data4/current/blk_-4668368595109805817 for deletion
2013-10-31 16:18:12,494 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1663768746748666765_1339 file build/test/data/dfs/data/data4/current/blk_-1663768746748666765 for deletion
2013-10-31 16:18:12,495 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4668368595109805817_1342 at file build/test/data/dfs/data/data4/current/blk_-4668368595109805817
2013-10-31 16:18:12,495 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1513594355081957583_1342 file build/test/data/dfs/data/data3/current/blk_-1513594355081957583 for deletion
2013-10-31 16:18:12,495 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1663768746748666765_1339 at file build/test/data/dfs/data/data4/current/blk_-1663768746748666765
2013-10-31 16:18:12,495 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_715915181680467880_1326 file build/test/data/dfs/data/data3/current/blk_715915181680467880 for deletion
2013-10-31 16:18:12,495 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1513594355081957583_1342 at file build/test/data/dfs/data/data3/current/blk_-1513594355081957583
2013-10-31 16:18:12,496 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777050699776076643_1329 file build/test/data/dfs/data/data3/current/blk_777050699776076643 for deletion
2013-10-31 16:18:12,496 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_715915181680467880_1326 at file build/test/data/dfs/data/data3/current/blk_715915181680467880
2013-10-31 16:18:12,496 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2852820014732100186_1330 file build/test/data/dfs/data/data3/current/blk_2852820014732100186 for deletion
2013-10-31 16:18:12,496 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777050699776076643_1329 at file build/test/data/dfs/data/data3/current/blk_777050699776076643
2013-10-31 16:18:12,497 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4468907177856788027_1325 file build/test/data/dfs/data/data4/current/blk_4468907177856788027 for deletion
2013-10-31 16:18:12,497 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2852820014732100186_1330 at file build/test/data/dfs/data/data3/current/blk_2852820014732100186
2013-10-31 16:18:12,497 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4468907177856788027_1325 at file build/test/data/dfs/data/data4/current/blk_4468907177856788027
2013-10-31 16:18:12,497 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5223740880924984010_1329 file build/test/data/dfs/data/data4/current/blk_5223740880924984010 for deletion
2013-10-31 16:18:12,498 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5935025676836584846_1323 file build/test/data/dfs/data/data3/current/blk_5935025676836584846 for deletion
2013-10-31 16:18:12,498 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5223740880924984010_1329 at file build/test/data/dfs/data/data4/current/blk_5223740880924984010
2013-10-31 16:18:12,498 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5935025676836584846_1323 at file build/test/data/dfs/data/data3/current/blk_5935025676836584846
2013-10-31 16:18:12,498 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6018207326177541389_1341 file build/test/data/dfs/data/data3/current/blk_6018207326177541389 for deletion
2013-10-31 16:18:12,499 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7018752213662655129_1339 file build/test/data/dfs/data/data3/current/blk_7018752213662655129 for deletion
2013-10-31 16:18:12,499 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6018207326177541389_1341 at file build/test/data/dfs/data/data3/current/blk_6018207326177541389
2013-10-31 16:18:12,499 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7470160298863947644_1336 file build/test/data/dfs/data/data4/current/blk_7470160298863947644 for deletion
2013-10-31 16:18:12,499 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7018752213662655129_1339 at file build/test/data/dfs/data/data3/current/blk_7018752213662655129
2013-10-31 16:18:12,499 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7470160298863947644_1336 at file build/test/data/dfs/data/data4/current/blk_7470160298863947644
2013-10-31 16:18:12,499 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8577440969405303007_1329 file build/test/data/dfs/data/data4/current/blk_8577440969405303007 for deletion
2013-10-31 16:18:12,500 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8577440969405303007_1329 at file build/test/data/dfs/data/data4/current/blk_8577440969405303007
2013-10-31 16:18:12,734 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0031_m_000007_0' to tip task_20131031160444934_0031_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:12,742 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000000_0'
2013-10-31 16:18:12,742 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000001_0'
2013-10-31 16:18:12,742 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000006_0'
2013-10-31 16:18:12,744 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000007_0 task's state:UNASSIGNED
2013-10-31 16:18:12,744 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000007_0 which needs 1 slots
2013-10-31 16:18:12,745 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000007_0 which needs 1 slots
2013-10-31 16:18:12,746 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000002_0'
2013-10-31 16:18:12,746 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000003_0'
2013-10-31 16:18:12,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken	dst=null	perm=null
2013-10-31 16:18:12,755 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49431, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4541719979601510441_1363, duration: 349528
2013-10-31 16:18:12,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml	dst=null	perm=null
2013-10-31 16:18:12,765 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36331, bytes: 30508, op: HDFS_READ, cliID: DFSClient_-1507310307, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1855502406512099239_1360, duration: 414782
2013-10-31 16:18:12,795 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:12,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar	dst=null	perm=null
2013-10-31 16:18:12,820 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49434, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1507310307, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2293510353387054922_1357, duration: 1488794
2013-10-31 16:18:12,912 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0030_m_407080348
2013-10-31 16:18:12,918 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28679 with signal TERM. Exit code 0
2013-10-31 16:18:12,918 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_1525606085
2013-10-31 16:18:12,919 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_1525606085 spawned.
2013-10-31 16:18:12,920 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000007_0/taskjvm.sh
2013-10-31 16:18:13,109 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4844518074889198090_1343 file build/test/data/dfs/data/data6/current/blk_-4844518074889198090 for deletion
2013-10-31 16:18:13,109 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4668368595109805817_1342 file build/test/data/dfs/data/data5/current/blk_-4668368595109805817 for deletion
2013-10-31 16:18:13,109 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4844518074889198090_1343 at file build/test/data/dfs/data/data6/current/blk_-4844518074889198090
2013-10-31 16:18:13,109 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1663768746748666765_1339 file build/test/data/dfs/data/data6/current/blk_-1663768746748666765 for deletion
2013-10-31 16:18:13,110 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4668368595109805817_1342 at file build/test/data/dfs/data/data5/current/blk_-4668368595109805817
2013-10-31 16:18:13,110 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1663768746748666765_1339 at file build/test/data/dfs/data/data6/current/blk_-1663768746748666765
2013-10-31 16:18:13,110 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777050699776076643_1329 file build/test/data/dfs/data/data6/current/blk_777050699776076643 for deletion
2013-10-31 16:18:13,111 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4468907177856788027_1325 file build/test/data/dfs/data/data5/current/blk_4468907177856788027 for deletion
2013-10-31 16:18:13,111 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777050699776076643_1329 at file build/test/data/dfs/data/data6/current/blk_777050699776076643
2013-10-31 16:18:13,111 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4468907177856788027_1325 at file build/test/data/dfs/data/data5/current/blk_4468907177856788027
2013-10-31 16:18:13,111 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5935025676836584846_1323 file build/test/data/dfs/data/data5/current/blk_5935025676836584846 for deletion
2013-10-31 16:18:13,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7018752213662655129_1339 file build/test/data/dfs/data/data5/current/blk_7018752213662655129 for deletion
2013-10-31 16:18:13,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5935025676836584846_1323 at file build/test/data/dfs/data/data5/current/blk_5935025676836584846
2013-10-31 16:18:13,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7470160298863947644_1336 file build/test/data/dfs/data/data5/current/blk_7470160298863947644 for deletion
2013-10-31 16:18:13,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7018752213662655129_1339 at file build/test/data/dfs/data/data5/current/blk_7018752213662655129
2013-10-31 16:18:13,113 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7470160298863947644_1336 at file build/test/data/dfs/data/data5/current/blk_7470160298863947644
2013-10-31 16:18:13,638 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:13,638 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:13,639 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:13,639 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_407080348 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:18:14,496 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_1525606085 given task: attempt_20131031160444934_0031_m_000007_0
2013-10-31 16:18:14,787 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0030
2013-10-31 16:18:14,787 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000005_0 not found in cache
2013-10-31 16:18:14,787 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000004_0 not found in cache
2013-10-31 16:18:14,787 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0030 for user-log deletion with retainTimeStamp:1383322694787
2013-10-31 16:18:14,790 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0030_m_-1035919601 since job job_20131031160444934_0030 is dead
2013-10-31 16:18:14,794 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29177 with signal TERM. Exit code 0
2013-10-31 16:18:14,942 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:14,942 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:14,942 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:14,943 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_-1035919601 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:14,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:15,103 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-2293510353387054922_1357 to 127.0.0.1:41648 
2013-10-31 16:18:15,105 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2293510353387054922_1357 src: /127.0.0.1:56440 dest: /127.0.0.1:41648
2013-10-31 16:18:15,106 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-2293510353387054922_1357 to /127.0.0.1:41648
2013-10-31 16:18:15,109 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2293510353387054922_1357 src: /127.0.0.1:56440 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:18:15,113 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2293510353387054922_1357 size 238055
2013-10-31 16:18:15,337 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_6018207326177541389_1341 blk_7470160298863947644_1336 blk_5223740880924984010_1329 blk_-1513594355081957583_1342 blk_777050699776076643_1329 blk_5935025676836584846_1323 blk_-1663768746748666765_1339 blk_-5985565395941547146_1350 blk_2852820014732100186_1330 blk_715915181680467880_1326 blk_8577440969405303007_1329 blk_-4668368595109805817_1342
2013-10-31 16:18:15,338 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_6018207326177541389_1341 blk_5223740880924984010_1329 blk_-1513594355081957583_1342 blk_7018752213662655129_1339 blk_4468907177856788027_1325 blk_-5985565395941547146_1350 blk_2852820014732100186_1330 blk_715915181680467880_1326 blk_8577440969405303007_1329 blk_-4844518074889198090_1343
2013-10-31 16:18:15,581 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0030_m_-469071112 since job job_20131031160444934_0030 is dead
2013-10-31 16:18:15,592 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28935 with signal TERM. Exit code 0
2013-10-31 16:18:15,763 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:15,764 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:15,764 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:15,764 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_-469071112 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:17,745 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0030
2013-10-31 16:18:17,745 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000000_0 not found in cache
2013-10-31 16:18:17,745 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000001_0 not found in cache
2013-10-31 16:18:17,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0030 for user-log deletion with retainTimeStamp:1383322697746
2013-10-31 16:18:17,747 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0030
2013-10-31 16:18:17,748 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000003_0 not found in cache
2013-10-31 16:18:17,748 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000002_0 not found in cache
2013-10-31 16:18:17,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0030 for user-log deletion with retainTimeStamp:1383322697748
2013-10-31 16:18:17,894 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5985565395941547146_1350 file build/test/data/dfs/data/data1/current/blk_-5985565395941547146 for deletion
2013-10-31 16:18:17,894 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4844518074889198090_1343 file build/test/data/dfs/data/data1/current/blk_-4844518074889198090 for deletion
2013-10-31 16:18:17,894 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5985565395941547146_1350 at file build/test/data/dfs/data/data1/current/blk_-5985565395941547146
2013-10-31 16:18:17,894 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1513594355081957583_1342 file build/test/data/dfs/data/data2/current/blk_-1513594355081957583 for deletion
2013-10-31 16:18:17,895 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4844518074889198090_1343 at file build/test/data/dfs/data/data1/current/blk_-4844518074889198090
2013-10-31 16:18:17,895 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_715915181680467880_1326 file build/test/data/dfs/data/data2/current/blk_715915181680467880 for deletion
2013-10-31 16:18:17,895 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1513594355081957583_1342 at file build/test/data/dfs/data/data2/current/blk_-1513594355081957583
2013-10-31 16:18:17,895 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2852820014732100186_1330 file build/test/data/dfs/data/data1/current/blk_2852820014732100186 for deletion
2013-10-31 16:18:17,895 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_715915181680467880_1326 at file build/test/data/dfs/data/data2/current/blk_715915181680467880
2013-10-31 16:18:17,896 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4468907177856788027_1325 file build/test/data/dfs/data/data1/current/blk_4468907177856788027 for deletion
2013-10-31 16:18:17,896 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2852820014732100186_1330 at file build/test/data/dfs/data/data1/current/blk_2852820014732100186
2013-10-31 16:18:17,896 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5223740880924984010_1329 file build/test/data/dfs/data/data2/current/blk_5223740880924984010 for deletion
2013-10-31 16:18:17,896 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4468907177856788027_1325 at file build/test/data/dfs/data/data1/current/blk_4468907177856788027
2013-10-31 16:18:17,896 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6018207326177541389_1341 file build/test/data/dfs/data/data1/current/blk_6018207326177541389 for deletion
2013-10-31 16:18:17,897 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5223740880924984010_1329 at file build/test/data/dfs/data/data2/current/blk_5223740880924984010
2013-10-31 16:18:17,897 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6018207326177541389_1341 at file build/test/data/dfs/data/data1/current/blk_6018207326177541389
2013-10-31 16:18:17,897 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7018752213662655129_1339 file build/test/data/dfs/data/data2/current/blk_7018752213662655129 for deletion
2013-10-31 16:18:17,898 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8577440969405303007_1329 file build/test/data/dfs/data/data1/current/blk_8577440969405303007 for deletion
2013-10-31 16:18:17,898 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7018752213662655129_1339 at file build/test/data/dfs/data/data2/current/blk_7018752213662655129
2013-10-31 16:18:17,898 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8577440969405303007_1329 at file build/test/data/dfs/data/data1/current/blk_8577440969405303007
2013-10-31 16:18:17,917 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000007_0 0.0% setup
2013-10-31 16:18:17,922 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000007_0 is done.
2013-10-31 16:18:17,922 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000007_0  was -1
2013-10-31 16:18:17,922 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:18,105 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5985565395941547146_1350 file build/test/data/dfs/data/data8/current/blk_-5985565395941547146 for deletion
2013-10-31 16:18:18,105 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4668368595109805817_1342 file build/test/data/dfs/data/data8/current/blk_-4668368595109805817 for deletion
2013-10-31 16:18:18,105 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5985565395941547146_1350 at file build/test/data/dfs/data/data8/current/blk_-5985565395941547146
2013-10-31 16:18:18,106 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1663768746748666765_1339 file build/test/data/dfs/data/data8/current/blk_-1663768746748666765 for deletion
2013-10-31 16:18:18,106 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4668368595109805817_1342 at file build/test/data/dfs/data/data8/current/blk_-4668368595109805817
2013-10-31 16:18:18,106 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1513594355081957583_1342 file build/test/data/dfs/data/data7/current/blk_-1513594355081957583 for deletion
2013-10-31 16:18:18,106 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1663768746748666765_1339 at file build/test/data/dfs/data/data8/current/blk_-1663768746748666765
2013-10-31 16:18:18,106 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_715915181680467880_1326 file build/test/data/dfs/data/data8/current/blk_715915181680467880 for deletion
2013-10-31 16:18:18,106 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1513594355081957583_1342 at file build/test/data/dfs/data/data7/current/blk_-1513594355081957583
2013-10-31 16:18:18,107 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_715915181680467880_1326 at file build/test/data/dfs/data/data8/current/blk_715915181680467880
2013-10-31 16:18:18,107 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777050699776076643_1329 file build/test/data/dfs/data/data8/current/blk_777050699776076643 for deletion
2013-10-31 16:18:18,107 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2852820014732100186_1330 file build/test/data/dfs/data/data8/current/blk_2852820014732100186 for deletion
2013-10-31 16:18:18,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777050699776076643_1329 at file build/test/data/dfs/data/data8/current/blk_777050699776076643
2013-10-31 16:18:18,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5223740880924984010_1329 file build/test/data/dfs/data/data7/current/blk_5223740880924984010 for deletion
2013-10-31 16:18:18,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2852820014732100186_1330 at file build/test/data/dfs/data/data8/current/blk_2852820014732100186
2013-10-31 16:18:18,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5935025676836584846_1323 file build/test/data/dfs/data/data8/current/blk_5935025676836584846 for deletion
2013-10-31 16:18:18,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5223740880924984010_1329 at file build/test/data/dfs/data/data7/current/blk_5223740880924984010
2013-10-31 16:18:18,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6018207326177541389_1341 file build/test/data/dfs/data/data7/current/blk_6018207326177541389 for deletion
2013-10-31 16:18:18,109 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5935025676836584846_1323 at file build/test/data/dfs/data/data8/current/blk_5935025676836584846
2013-10-31 16:18:18,109 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6018207326177541389_1341 at file build/test/data/dfs/data/data7/current/blk_6018207326177541389
2013-10-31 16:18:18,109 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7470160298863947644_1336 file build/test/data/dfs/data/data7/current/blk_7470160298863947644 for deletion
2013-10-31 16:18:18,110 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8577440969405303007_1329 file build/test/data/dfs/data/data7/current/blk_8577440969405303007 for deletion
2013-10-31 16:18:18,110 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7470160298863947644_1336 at file build/test/data/dfs/data/data7/current/blk_7470160298863947644
2013-10-31 16:18:18,110 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8577440969405303007_1329 at file build/test/data/dfs/data/data7/current/blk_8577440969405303007
2013-10-31 16:18:18,466 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0030_m_767723640 since job job_20131031160444934_0030 is dead
2013-10-31 16:18:18,476 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28896 with signal TERM. Exit code 0
2013-10-31 16:18:18,559 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0030_m_1871656188 since job job_20131031160444934_0030 is dead
2013-10-31 16:18:18,564 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28936 with signal TERM. Exit code 0
2013-10-31 16:18:18,684 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:18,684 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:18,684 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:18,685 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_767723640 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:18,704 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:18,705 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:18,705 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:18,705 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_1871656188 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:18,751 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000007_0' has completed task_20131031160444934_0031_m_000007 successfully.
2013-10-31 16:18:18,754 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000000_0' to tip task_20131031160444934_0031_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:18,755 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000000
2013-10-31 16:18:18,756 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000001_0' to tip task_20131031160444934_0031_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:18,756 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000001
2013-10-31 16:18:18,758 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000002_0' to tip task_20131031160444934_0031_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:18:18,759 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:18:18,760 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000002
2013-10-31 16:18:18,761 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:18:18,761 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000003_0' to tip task_20131031160444934_0031_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:18:18,761 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000000_0 which needs 1 slots
2013-10-31 16:18:18,761 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000000_0 which needs 1 slots
2013-10-31 16:18:18,761 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000003
2013-10-31 16:18:18,762 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000001_0 which needs 1 slots
2013-10-31 16:18:18,762 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0031_m_000001_0 which needs 1 slots
2013-10-31 16:18:18,768 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:18:18,769 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:18:18,770 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000002_0 which needs 1 slots
2013-10-31 16:18:18,770 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000002_0 which needs 1 slots
2013-10-31 16:18:18,770 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000003_0 which needs 1 slots
2013-10-31 16:18:18,771 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0031_m_000003_0 which needs 1 slots
2013-10-31 16:18:18,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken	dst=null	perm=null
2013-10-31 16:18:18,779 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36336, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4541719979601510441_1363, duration: 287806
2013-10-31 16:18:18,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml	dst=null	perm=null
2013-10-31 16:18:18,790 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36338, bytes: 30508, op: HDFS_READ, cliID: DFSClient_-739213233, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1855502406512099239_1360, duration: 505809
2013-10-31 16:18:18,796 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000004_0' to tip task_20131031160444934_0031_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:18:18,796 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000004
2013-10-31 16:18:18,797 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000005_0' to tip task_20131031160444934_0031_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:18:18,797 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000005
2013-10-31 16:18:18,802 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:18:18,802 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:18:18,802 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000004_0 which needs 1 slots
2013-10-31 16:18:18,802 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000004_0 which needs 1 slots
2013-10-31 16:18:18,803 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000005_0 which needs 1 slots
2013-10-31 16:18:18,803 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0031_m_000005_0 which needs 1 slots
2013-10-31 16:18:18,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken	dst=null	perm=null
2013-10-31 16:18:18,810 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0031/attempt_20131031160444934_0031_m_000001_0. Attempting to reuse: jvm_20131031160444934_0031_m_1525606085
2013-10-31 16:18:18,811 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0030_m_357915176
2013-10-31 16:18:18,811 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36339, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4541719979601510441_1363, duration: 839604
2013-10-31 16:18:18,815 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28830 with signal TERM. Exit code 0
2013-10-31 16:18:18,815 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_-1669483909
2013-10-31 16:18:18,817 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_-1669483909 spawned.
2013-10-31 16:18:18,820 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000000_0/taskjvm.sh
2013-10-31 16:18:18,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml	dst=null	perm=null
2013-10-31 16:18:18,825 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56446, bytes: 30508, op: HDFS_READ, cliID: DFSClient_1990509339, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1855502406512099239_1360, duration: 387824
2013-10-31 16:18:18,866 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:18,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar	dst=null	perm=null
2013-10-31 16:18:18,892 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49444, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1990509339, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2293510353387054922_1357, duration: 585290
2013-10-31 16:18:18,893 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:18,893 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:18,893 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:18,893 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_357915176 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:18,945 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_-2127491649
2013-10-31 16:18:18,946 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_-2127491649 spawned.
2013-10-31 16:18:18,948 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000004_0/taskjvm.sh
2013-10-31 16:18:18,967 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_1249270322
2013-10-31 16:18:18,968 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_1249270322 spawned.
2013-10-31 16:18:18,969 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000005_0/taskjvm.sh
2013-10-31 16:18:19,267 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_1525606085 given task: attempt_20131031160444934_0031_m_000001_0
2013-10-31 16:18:19,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=null
2013-10-31 16:18:19,390 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36344, bytes: 2093, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4889450459518297417_1358, duration: 400264
2013-10-31 16:18:19,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:18:19,432 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36345, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 251796
2013-10-31 16:18:19,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:18:19,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:18:19,754 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36415, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 285226
2013-10-31 16:18:20,528 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:20,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar	dst=null	perm=null
2013-10-31 16:18:20,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36416, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-739213233, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2293510353387054922_1357, duration: 1456597
2013-10-31 16:18:20,916 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_-1679966884
2013-10-31 16:18:20,916 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_-1679966884 spawned.
2013-10-31 16:18:20,917 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_-1457722047
2013-10-31 16:18:20,917 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_-1457722047 spawned.
2013-10-31 16:18:20,918 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000002_0/taskjvm.sh
2013-10-31 16:18:20,919 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000003_0/taskjvm.sh
2013-10-31 16:18:21,375 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_-1669483909 given task: attempt_20131031160444934_0031_m_000000_0
2013-10-31 16:18:21,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=null
2013-10-31 16:18:21,880 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49454, bytes: 2093, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 178024
2013-10-31 16:18:21,924 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_1249270322 given task: attempt_20131031160444934_0031_m_000005_0
2013-10-31 16:18:21,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt	dst=null	perm=null
2013-10-31 16:18:21,952 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_-2127491649 given task: attempt_20131031160444934_0031_m_000004_0
2013-10-31 16:18:22,120 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_-1457722047 given task: attempt_20131031160444934_0031_m_000003_0
2013-10-31 16:18:22,161 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_-1679966884 given task: attempt_20131031160444934_0031_m_000002_0
2013-10-31 16:18:22,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:18:22,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt	dst=null	perm=null
2013-10-31 16:18:22,244 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36424, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 149134
2013-10-31 16:18:22,248 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56461, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 116152
2013-10-31 16:18:22,352 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+26
2013-10-31 16:18:22,353 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000001_0 is done.
2013-10-31 16:18:22,353 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000001_0  was 564
2013-10-31 16:18:22,354 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:22,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=null
2013-10-31 16:18:22,447 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49461, bytes: 545, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000005_0, offset: 1536, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 157757
2013-10-31 16:18:22,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=null
2013-10-31 16:18:22,453 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49462, bytes: 1061, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 144855
2013-10-31 16:18:22,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:18:22,487 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49463, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000005_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 107684
2013-10-31 16:18:22,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:18:22,493 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49464, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 101934
2013-10-31 16:18:22,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=null
2013-10-31 16:18:22,643 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49467, bytes: 1061, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 161704
2013-10-31 16:18:22,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split	dst=null	perm=null
2013-10-31 16:18:22,663 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36366, bytes: 1577, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4889450459518297417_1358, duration: 152804
2013-10-31 16:18:22,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:18:22,683 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36367, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 137065
2013-10-31 16:18:22,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:18:22,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:18:22,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:18:22,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:18:22,782 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36368, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000005_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 1390532
2013-10-31 16:18:22,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:18:22,786 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56474, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 129920
2013-10-31 16:18:22,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:18:22,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:18:22,973 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36370, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 144779
2013-10-31 16:18:22,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:18:22,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:18:22,988 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49473, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 105543
2013-10-31 16:18:22,991 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36372, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 123276
2013-10-31 16:18:23,761 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0031_m_000007_0
2013-10-31 16:18:23,762 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0031_m_000007_0
2013-10-31 16:18:23,762 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0031_m_000007_0 not found in cache
2013-10-31 16:18:24,764 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000001_0' has completed task_20131031160444934_0031_m_000001 successfully.
2013-10-31 16:18:24,766 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0031_r_000000_0' to tip task_20131031160444934_0031_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:24,769 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:18:24,769 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_r_000000_0 which needs 1 slots
2013-10-31 16:18:24,769 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_r_000000_0 which needs 1 slots
2013-10-31 16:18:24,805 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+26
2013-10-31 16:18:24,807 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_r_-825662118
2013-10-31 16:18:24,808 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_r_-825662118 spawned.
2013-10-31 16:18:24,808 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000000_0 is done.
2013-10-31 16:18:24,808 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000000_0  was 595
2013-10-31 16:18:24,809 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:24,811 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_r_000000_0/taskjvm.sh
2013-10-31 16:18:25,372 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000005_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:18+1
2013-10-31 16:18:25,374 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000005_0 is done.
2013-10-31 16:18:25,374 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000005_0  was 6
2013-10-31 16:18:25,374 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:25,379 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+6
2013-10-31 16:18:25,380 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000004_0 is done.
2013-10-31 16:18:25,380 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000004_0  was 68
2013-10-31 16:18:25,380 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:25,561 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:6+6
2013-10-31 16:18:25,563 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000003_0 is done.
2013-10-31 16:18:25,563 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000003_0  was 37
2013-10-31 16:18:25,563 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:25,589 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+6
2013-10-31 16:18:25,590 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000002_0 is done.
2013-10-31 16:18:25,590 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000002_0  was 68
2013-10-31 16:18:25,590 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:26,055 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_r_-825662118 given task: attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:27,771 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000000_0' has completed task_20131031160444934_0031_m_000000 successfully.
2013-10-31 16:18:27,778 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000002_0' has completed task_20131031160444934_0031_m_000002 successfully.
2013-10-31 16:18:27,779 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000003_0' has completed task_20131031160444934_0031_m_000003 successfully.
2013-10-31 16:18:27,808 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000004_0' has completed task_20131031160444934_0031_m_000004 successfully.
2013-10-31 16:18:27,809 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000005_0' has completed task_20131031160444934_0031_m_000005 successfully.
2013-10-31 16:18:31,739 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:48169, bytes: 564, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000001_0, duration: 10924526
2013-10-31 16:18:31,765 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:48169, bytes: 595, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000000_0, duration: 11963329
2013-10-31 16:18:31,783 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60102, bytes: 68, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000002_0, duration: 13090663
2013-10-31 16:18:31,798 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60102, bytes: 37, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000003_0, duration: 11348065
2013-10-31 16:18:31,816 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:44305, bytes: 68, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000004_0, duration: 13019891
2013-10-31 16:18:31,833 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:44306, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000005_0, duration: 11893389
2013-10-31 16:18:32,531 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:18:32,585 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:18:32,642 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:18:32,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:32,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:32,923 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000. blk_6379554650965270610_1364
2013-10-31 16:18:32,959 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6379554650965270610_1364 src: /127.0.0.1:36380 dest: /127.0.0.1:50942
2013-10-31 16:18:32,961 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6379554650965270610_1364 src: /127.0.0.1:49483 dest: /127.0.0.1:47311
2013-10-31 16:18:32,961 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6379554650965270610_1364 src: /127.0.0.1:56487 dest: /127.0.0.1:41648
2013-10-31 16:18:32,967 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56487, dest: /127.0.0.1:41648, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0031_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6379554650965270610_1364, duration: 3186810
2013-10-31 16:18:32,967 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6379554650965270610_1364 terminating
2013-10-31 16:18:32,967 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49483, dest: /127.0.0.1:47311, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0031_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6379554650965270610_1364, duration: 4511655
2013-10-31 16:18:32,967 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6379554650965270610_1364 terminating
2013-10-31 16:18:32,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36380, dest: /127.0.0.1:50942, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0031_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6379554650965270610_1364, duration: 4885016
2013-10-31 16:18:32,968 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6379554650965270610_1364 terminating
2013-10-31 16:18:32,970 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6379554650965270610_1364 size 592
2013-10-31 16:18:32,971 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:32,971 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:32,971 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6379554650965270610_1364 size 592
2013-10-31 16:18:32,971 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6379554650965270610_1364 size 592
2013-10-31 16:18:33,013 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0031_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:33,014 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:18:33,781 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   6 OK for attempt_20131031160444934_0031_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:18:33,782 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:34,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0	dst=null	perm=null
2013-10-31 16:18:34,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:34,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:34,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0	dst=null	perm=null
2013-10-31 16:18:35,585 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 1.0% reduce > reduce
2013-10-31 16:18:35,588 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 1.0% reduce > reduce
2013-10-31 16:18:35,589 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_r_000000_0 is done.
2013-10-31 16:18:35,590 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_r_000000_0  was -1
2013-10-31 16:18:35,590 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:36,786 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_r_000000_0' has completed task_20131031160444934_0031_r_000000 successfully.
2013-10-31 16:18:36,789 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0031_m_000006_0' to tip task_20131031160444934_0031_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:36,791 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:18:36,792 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000006_0 which needs 1 slots
2013-10-31 16:18:36,792 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000006_0 which needs 1 slots
2013-10-31 16:18:36,830 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0031/attempt_20131031160444934_0031_m_000006_0. Attempting to reuse: jvm_20131031160444934_0031_m_1525606085
2013-10-31 16:18:37,885 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_1525606085 given task: attempt_20131031160444934_0031_m_000006_0
2013-10-31 16:18:37,988 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000006_0 0.0% 
2013-10-31 16:18:37,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary	dst=null	perm=null
2013-10-31 16:18:38,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:38,013 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS from client DFSClient_attempt_20131031160444934_0031_m_000006_0
2013-10-31 16:18:38,013 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0031_m_000006_0
2013-10-31 16:18:38,022 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2293510353387054922 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:38,023 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2293510353387054922 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:38,023 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2293510353387054922 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:38,023 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2293510353387054922 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:38,023 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4889450459518297417 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:38,023 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4889450459518297417 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:38,023 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4889450459518297417 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:38,023 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4889450459518297417 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:38,024 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6095635965794745357 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:38,024 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6095635965794745357 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:38,024 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6095635965794745357 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:38,024 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1855502406512099239 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:38,024 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1855502406512099239 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:38,024 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1855502406512099239 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:38,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031	dst=null	perm=null
2013-10-31 16:18:39,342 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_1855502406512099239_1360 blk_-2293510353387054922_1357 blk_6095635965794745357_1359 blk_4889450459518297417_1358
2013-10-31 16:18:39,342 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-2293510353387054922_1357 blk_6095635965794745357_1359 blk_4889450459518297417_1358
2013-10-31 16:18:39,847 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:18:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,869 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,874 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,880 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,885 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,890 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,890 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:18:40,961 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000006_0 0.0% cleanup
2013-10-31 16:18:40,963 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000006_0 is done.
2013-10-31 16:18:40,963 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000006_0  was -1
2013-10-31 16:18:40,963 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:41,792 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:41,792 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:41,902 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2293510353387054922_1357 file build/test/data/dfs/data/data2/current/blk_-2293510353387054922 for deletion
2013-10-31 16:18:41,902 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4889450459518297417_1358 file build/test/data/dfs/data/data1/current/blk_4889450459518297417 for deletion
2013-10-31 16:18:41,902 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2293510353387054922_1357 at file build/test/data/dfs/data/data2/current/blk_-2293510353387054922
2013-10-31 16:18:41,903 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4889450459518297417_1358 at file build/test/data/dfs/data/data1/current/blk_4889450459518297417
2013-10-31 16:18:41,902 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6095635965794745357_1359 file build/test/data/dfs/data/data2/current/blk_6095635965794745357 for deletion
2013-10-31 16:18:41,903 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6095635965794745357_1359 at file build/test/data/dfs/data/data2/current/blk_6095635965794745357
2013-10-31 16:18:42,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2293510353387054922_1357 file build/test/data/dfs/data/data8/current/blk_-2293510353387054922 for deletion
2013-10-31 16:18:42,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1855502406512099239_1360 file build/test/data/dfs/data/data7/current/blk_1855502406512099239 for deletion
2013-10-31 16:18:42,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4889450459518297417_1358 file build/test/data/dfs/data/data7/current/blk_4889450459518297417 for deletion
2013-10-31 16:18:42,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1855502406512099239_1360 at file build/test/data/dfs/data/data7/current/blk_1855502406512099239
2013-10-31 16:18:42,113 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6095635965794745357_1359 file build/test/data/dfs/data/data8/current/blk_6095635965794745357 for deletion
2013-10-31 16:18:42,113 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4889450459518297417_1358 at file build/test/data/dfs/data/data7/current/blk_4889450459518297417
2013-10-31 16:18:42,112 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2293510353387054922_1357 at file build/test/data/dfs/data/data8/current/blk_-2293510353387054922
2013-10-31 16:18:42,113 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6095635965794745357_1359 at file build/test/data/dfs/data/data8/current/blk_6095635965794745357
2013-10-31 16:18:42,343 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_1855502406512099239_1360 blk_-2293510353387054922_1357 blk_4889450459518297417_1358
2013-10-31 16:18:42,343 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_1855502406512099239_1360 blk_-2293510353387054922_1357 blk_6095635965794745357_1359 blk_4889450459518297417_1358
2013-10-31 16:18:42,502 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2293510353387054922_1357 file build/test/data/dfs/data/data4/current/blk_-2293510353387054922 for deletion
2013-10-31 16:18:42,502 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1855502406512099239_1360 file build/test/data/dfs/data/data3/current/blk_1855502406512099239 for deletion
2013-10-31 16:18:42,502 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2293510353387054922_1357 at file build/test/data/dfs/data/data4/current/blk_-2293510353387054922
2013-10-31 16:18:42,502 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1855502406512099239_1360 at file build/test/data/dfs/data/data3/current/blk_1855502406512099239
2013-10-31 16:18:42,502 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4889450459518297417_1358 file build/test/data/dfs/data/data3/current/blk_4889450459518297417 for deletion
2013-10-31 16:18:42,503 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6095635965794745357_1359 file build/test/data/dfs/data/data4/current/blk_6095635965794745357 for deletion
2013-10-31 16:18:42,503 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4889450459518297417_1358 at file build/test/data/dfs/data/data3/current/blk_4889450459518297417
2013-10-31 16:18:42,504 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6095635965794745357_1359 at file build/test/data/dfs/data/data4/current/blk_6095635965794745357
2013-10-31 16:18:42,799 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000006_0' has completed task_20131031160444934_0031_m_000006 successfully.
2013-10-31 16:18:42,800 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0031 has completed successfully.
2013-10-31 16:18:42,801 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0031,submitTime=1383236291295,launchTime=1383236291425,firstMapTaskLaunchTime=1383236298754,firstReduceTaskLaunchTime=1383236304766,firstJobSetupTaskLaunchTime=1383236292734,firstJobCleanupTaskLaunchTime=1383236316789,finishTime=1383236322800,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=41,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D96525F7519540D2B864433F7B9A034C/CAD0F875B066468E827D7271B68B25B0] cogrouping/(1/1) ...platform/joinsintocogroup
2013-10-31 16:18:42,805 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E. blk_-5164497478515678768_1365
2013-10-31 16:18:42,807 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5164497478515678768_1365 src: /127.0.0.1:56493 dest: /127.0.0.1:41648
2013-10-31 16:18:42,811 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5164497478515678768_1365 src: /127.0.0.1:36458 dest: /127.0.0.1:38271
2013-10-31 16:18:42,814 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5164497478515678768_1365 src: /127.0.0.1:49492 dest: /127.0.0.1:47311
2013-10-31 16:18:42,819 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49492, dest: /127.0.0.1:47311, bytes: 35430, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5164497478515678768_1365, duration: 2725697
2013-10-31 16:18:42,820 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5164497478515678768_1365 terminating
2013-10-31 16:18:42,820 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36458, dest: /127.0.0.1:38271, bytes: 35430, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5164497478515678768_1365, duration: 3604649
2013-10-31 16:18:42,821 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5164497478515678768_1365 terminating
2013-10-31 16:18:42,821 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56493, dest: /127.0.0.1:41648, bytes: 35430, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5164497478515678768_1365, duration: 4464644
2013-10-31 16:18:42,822 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5164497478515678768_1365 terminating
2013-10-31 16:18:42,827 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5164497478515678768_1365 size 35430
2013-10-31 16:18:42,832 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E from client DFSClient_-290827983
2013-10-31 16:18:42,833 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E is closed by DFSClient_-290827983
2013-10-31 16:18:42,833 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5164497478515678768_1365 size 35430
2013-10-31 16:18:42,833 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5164497478515678768_1365 size 35430
2013-10-31 16:18:42,843 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:18:42,844 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000000_0'
2013-10-31 16:18:42,845 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000001_0'
2013-10-31 16:18:42,845 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000006_0'
2013-10-31 16:18:42,846 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000007_0'
2013-10-31 16:18:42,846 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4541719979601510441 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:42,847 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_r_000000_0'
2013-10-31 16:18:42,847 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4541719979601510441 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:42,847 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4541719979601510441 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:42,847 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000004_0'
2013-10-31 16:18:42,848 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000005_0'
2013-10-31 16:18:42,848 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000002_0'
2013-10-31 16:18:42,848 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000003_0'
2013-10-31 16:18:42,850 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0031_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:18:42,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031	dst=null	perm=null
2013-10-31 16:18:42,855 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary
2013-10-31 16:18:42,855 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0031
2013-10-31 16:18:42,855 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0031 being deleted.
2013-10-31 16:18:42,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2013-10-31 16:18:42,875 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:42,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2013-10-31 16:18:42,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2013-10-31 16:18:42,880 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49494, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6379554650965270610_1364, duration: 399758
2013-10-31 16:18:42,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2013-10-31 16:18:42,899 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:42,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2013-10-31 16:18:42,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2013-10-31 16:18:42,904 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36393, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6379554650965270610_1364, duration: 371250
2013-10-31 16:18:42,905 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintocogroup
2013-10-31 16:18:42,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2013-10-31 16:18:42,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2013-10-31 16:18:42,914 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36394, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6379554650965270610_1364, duration: 414123
2013-10-31 16:18:42,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:42,924 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt. blk_-8193683770357719291_1366
2013-10-31 16:18:42,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8193683770357719291_1366 src: /127.0.0.1:56500 dest: /127.0.0.1:41648
2013-10-31 16:18:42,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8193683770357719291_1366 src: /127.0.0.1:36465 dest: /127.0.0.1:38271
2013-10-31 16:18:42,929 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8193683770357719291_1366 src: /127.0.0.1:49499 dest: /127.0.0.1:47311
2013-10-31 16:18:42,932 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49499, dest: /127.0.0.1:47311, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 65568
2013-10-31 16:18:42,932 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8193683770357719291_1366 terminating
2013-10-31 16:18:42,933 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36465, dest: /127.0.0.1:38271, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8193683770357719291_1366, duration: 901927
2013-10-31 16:18:42,933 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8193683770357719291_1366 terminating
2013-10-31 16:18:42,934 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56500, dest: /127.0.0.1:41648, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 1801755
2013-10-31 16:18:42,934 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8193683770357719291_1366 terminating
2013-10-31 16:18:42,934 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8193683770357719291_1366 size 83
2013-10-31 16:18:42,937 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt from client DFSClient_1457307213
2013-10-31 16:18:42,938 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt is closed by DFSClient_1457307213
2013-10-31 16:18:42,938 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8193683770357719291_1366 size 83
2013-10-31 16:18:42,939 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8193683770357719291_1366 size 83
2013-10-31 16:18:42,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:42,958 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt. blk_863628976355473469_1367
2013-10-31 16:18:42,960 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_863628976355473469_1367 src: /127.0.0.1:36467 dest: /127.0.0.1:38271
2013-10-31 16:18:42,961 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_863628976355473469_1367 src: /127.0.0.1:49501 dest: /127.0.0.1:47311
2013-10-31 16:18:42,963 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_863628976355473469_1367 src: /127.0.0.1:56505 dest: /127.0.0.1:41648
2013-10-31 16:18:42,980 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56505, dest: /127.0.0.1:41648, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 846303
2013-10-31 16:18:42,981 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_863628976355473469_1367 terminating
2013-10-31 16:18:42,981 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_863628976355473469_1367 size 48
2013-10-31 16:18:42,981 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49501, dest: /127.0.0.1:47311, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_863628976355473469_1367, duration: 1653170
2013-10-31 16:18:42,982 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_863628976355473469_1367 terminating
2013-10-31 16:18:42,982 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36467, dest: /127.0.0.1:38271, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 2677191
2013-10-31 16:18:42,984 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_863628976355473469_1367 terminating
2013-10-31 16:18:42,986 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_863628976355473469_1367 size 48
2013-10-31 16:18:42,986 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt from client DFSClient_1457307213
2013-10-31 16:18:42,987 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt is closed by DFSClient_1457307213
2013-10-31 16:18:42,989 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_863628976355473469_1367 size 48
2013-10-31 16:18:43,023 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:18:43,024 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:18:43,042 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:18:43,042 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt"]
2013-10-31 16:18:43,043 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt"]
2013-10-31 16:18:43,043 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextDelimited[[0:3]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner"]
2013-10-31 16:18:43,044 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:18:43,044 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:18:43,044 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:18:43,045 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...edpipesplatform/joininner
2013-10-31 16:18:43,048 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:18:43,048 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:18:43,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:43,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:18:43,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:43,072 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar. blk_4073126747153669157_1368
2013-10-31 16:18:43,074 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4073126747153669157_1368 src: /127.0.0.1:36470 dest: /127.0.0.1:38271
2013-10-31 16:18:43,075 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4073126747153669157_1368 src: /127.0.0.1:36402 dest: /127.0.0.1:50942
2013-10-31 16:18:43,077 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4073126747153669157_1368 src: /127.0.0.1:56508 dest: /127.0.0.1:41648
2013-10-31 16:18:43,085 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56508, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4073126747153669157_1368, duration: 3937184
2013-10-31 16:18:43,086 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4073126747153669157_1368 terminating
2013-10-31 16:18:43,086 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36402, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4073126747153669157_1368, duration: 4725331
2013-10-31 16:18:43,087 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4073126747153669157_1368 terminating
2013-10-31 16:18:43,087 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36470, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4073126747153669157_1368, duration: 5817952
2013-10-31 16:18:43,088 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4073126747153669157_1368 terminating
2013-10-31 16:18:43,088 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4073126747153669157_1368 size 238055
2013-10-31 16:18:43,090 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar from client DFSClient_1457307213
2013-10-31 16:18:43,090 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar is closed by DFSClient_1457307213
2013-10-31 16:18:43,091 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4073126747153669157_1368 size 238055
2013-10-31 16:18:43,092 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4073126747153669157_1368 size 238055
2013-10-31 16:18:43,097 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar. New replication is 10
2013-10-31 16:18:43,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar	dst=null	perm=null
2013-10-31 16:18:43,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:43,114 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:18:43,118 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:43,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2293510353387054922_1357 file build/test/data/dfs/data/data6/current/blk_-2293510353387054922 for deletion
2013-10-31 16:18:43,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1855502406512099239_1360 file build/test/data/dfs/data/data5/current/blk_1855502406512099239 for deletion
2013-10-31 16:18:43,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:43,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4889450459518297417_1358 file build/test/data/dfs/data/data6/current/blk_4889450459518297417 for deletion
2013-10-31 16:18:43,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1855502406512099239_1360 at file build/test/data/dfs/data/data5/current/blk_1855502406512099239
2013-10-31 16:18:43,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2293510353387054922_1357 at file build/test/data/dfs/data/data6/current/blk_-2293510353387054922
2013-10-31 16:18:43,120 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4889450459518297417_1358 at file build/test/data/dfs/data/data6/current/blk_4889450459518297417
2013-10-31 16:18:43,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:43,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:43,132 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split. New replication is 10
2013-10-31 16:18:44,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split	dst=null	perm=null
2013-10-31 16:18:44,591 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split. blk_2094033281312644685_1369
2013-10-31 16:18:44,593 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2094033281312644685_1369 src: /127.0.0.1:36473 dest: /127.0.0.1:38271
2013-10-31 16:18:44,595 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2094033281312644685_1369 src: /127.0.0.1:56510 dest: /127.0.0.1:41648
2013-10-31 16:18:44,596 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2094033281312644685_1369 src: /127.0.0.1:36406 dest: /127.0.0.1:50942
2013-10-31 16:18:44,598 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2094033281312644685_1369 src: /127.0.0.1:49509 dest: /127.0.0.1:47311
2013-10-31 16:18:44,601 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49509, dest: /127.0.0.1:47311, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2094033281312644685_1369, duration: 119932
2013-10-31 16:18:44,602 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2094033281312644685_1369 terminating
2013-10-31 16:18:44,602 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36406, dest: /127.0.0.1:50942, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2094033281312644685_1369, duration: 998518
2013-10-31 16:18:44,603 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2094033281312644685_1369 terminating
2013-10-31 16:18:44,603 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56510, dest: /127.0.0.1:41648, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2094033281312644685_1369, duration: 1929265
2013-10-31 16:18:44,603 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2094033281312644685_1369 size 1757
2013-10-31 16:18:44,604 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2094033281312644685_1369 terminating
2013-10-31 16:18:44,604 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36473, dest: /127.0.0.1:38271, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2094033281312644685_1369, duration: 2826568
2013-10-31 16:18:44,605 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2094033281312644685_1369 terminating
2013-10-31 16:18:44,609 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2094033281312644685_1369 size 1757
2013-10-31 16:18:44,609 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split from client DFSClient_1457307213
2013-10-31 16:18:44,610 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split is closed by DFSClient_1457307213
2013-10-31 16:18:44,610 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2094033281312644685_1369 size 1757
2013-10-31 16:18:44,610 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2094033281312644685_1369 size 1757
2013-10-31 16:18:44,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:44,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:44,630 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo. blk_5130222379336307247_1370
2013-10-31 16:18:44,631 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5130222379336307247_1370 src: /127.0.0.1:36408 dest: /127.0.0.1:50942
2013-10-31 16:18:44,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5130222379336307247_1370 src: /127.0.0.1:56514 dest: /127.0.0.1:41648
2013-10-31 16:18:44,634 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5130222379336307247_1370 src: /127.0.0.1:49512 dest: /127.0.0.1:47311
2013-10-31 16:18:44,637 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49512, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5130222379336307247_1370, duration: 65307
2013-10-31 16:18:44,638 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5130222379336307247_1370 terminating
2013-10-31 16:18:44,638 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56514, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5130222379336307247_1370, duration: 811197
2013-10-31 16:18:44,639 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5130222379336307247_1370 terminating
2013-10-31 16:18:44,639 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36408, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5130222379336307247_1370, duration: 1698262
2013-10-31 16:18:44,640 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5130222379336307247_1370 terminating
2013-10-31 16:18:44,642 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5130222379336307247_1370 size 183
2013-10-31 16:18:44,642 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5130222379336307247_1370 size 183
2013-10-31 16:18:44,643 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5130222379336307247_1370 size 183
2013-10-31 16:18:45,042 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:18:45,043 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:18:45,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,074 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml. blk_-5302370728116882745_1371
2013-10-31 16:18:45,075 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5302370728116882745_1371 src: /127.0.0.1:36411 dest: /127.0.0.1:50942
2013-10-31 16:18:45,077 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5302370728116882745_1371 src: /127.0.0.1:56517 dest: /127.0.0.1:41648
2013-10-31 16:18:45,079 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5302370728116882745_1371 src: /127.0.0.1:36482 dest: /127.0.0.1:38271
2013-10-31 16:18:45,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36482, dest: /127.0.0.1:38271, bytes: 28971, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5302370728116882745_1371, duration: 218749
2013-10-31 16:18:45,082 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5302370728116882745_1371 terminating
2013-10-31 16:18:45,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56517, dest: /127.0.0.1:41648, bytes: 28971, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5302370728116882745_1371, duration: 977782
2013-10-31 16:18:45,083 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5302370728116882745_1371 size 28971
2013-10-31 16:18:45,083 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5302370728116882745_1371 terminating
2013-10-31 16:18:45,084 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36411, dest: /127.0.0.1:50942, bytes: 28971, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5302370728116882745_1371, duration: 2227790
2013-10-31 16:18:45,084 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5302370728116882745_1371 terminating
2013-10-31 16:18:45,084 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5302370728116882745_1371 size 28971
2013-10-31 16:18:45,087 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml from client DFSClient_1457307213
2013-10-31 16:18:45,087 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml is closed by DFSClient_1457307213
2013-10-31 16:18:45,087 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5302370728116882745_1371 size 28971
2013-10-31 16:18:45,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml	dst=null	perm=null
2013-10-31 16:18:45,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36415, bytes: 29199, op: HDFS_READ, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5302370728116882745_1371, duration: 383179
2013-10-31 16:18:45,123 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0032: nMaps=5 nReduces=0 max=-1
2013-10-31 16:18:45,123 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0032 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:18:45,123 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0032
2013-10-31 16:18:45,123 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0032	RESULT=SUCCESS
2013-10-31 16:18:45,124 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0032
2013-10-31 16:18:45,125 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0032
2013-10-31 16:18:45,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,157 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_conf.xml. blk_-3532042759540428294_1373
2013-10-31 16:18:45,159 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3532042759540428294_1373 src: /127.0.0.1:49518 dest: /127.0.0.1:47311
2013-10-31 16:18:45,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3532042759540428294_1373 src: /127.0.0.1:36417 dest: /127.0.0.1:50942
2013-10-31 16:18:45,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3532042759540428294_1373 src: /127.0.0.1:36487 dest: /127.0.0.1:38271
2013-10-31 16:18:45,166 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36487, dest: /127.0.0.1:38271, bytes: 29036, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3532042759540428294_1373, duration: 656950
2013-10-31 16:18:45,166 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3532042759540428294_1373 terminating
2013-10-31 16:18:45,166 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3532042759540428294_1373 size 29036
2013-10-31 16:18:45,167 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36417, dest: /127.0.0.1:50942, bytes: 29036, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3532042759540428294_1373, duration: 1907150
2013-10-31 16:18:45,167 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3532042759540428294_1373 terminating
2013-10-31 16:18:45,168 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49518, dest: /127.0.0.1:47311, bytes: 29036, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3532042759540428294_1373, duration: 2526186
2013-10-31 16:18:45,168 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3532042759540428294_1373 terminating
2013-10-31 16:18:45,171 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3532042759540428294_1373 size 29036
2013-10-31 16:18:45,171 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_conf.xml from client DFSClient_-519505853
2013-10-31 16:18:45,172 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_conf.xml is closed by DFSClient_-519505853
2013-10-31 16:18:45,172 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3532042759540428294_1373 size 29036
2013-10-31 16:18:45,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,187 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken. blk_1424133611784958048_1374
2013-10-31 16:18:45,188 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424133611784958048_1374 src: /127.0.0.1:56524 dest: /127.0.0.1:41648
2013-10-31 16:18:45,190 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424133611784958048_1374 src: /127.0.0.1:36420 dest: /127.0.0.1:50942
2013-10-31 16:18:45,192 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424133611784958048_1374 src: /127.0.0.1:49523 dest: /127.0.0.1:47311
2013-10-31 16:18:45,195 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49523, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1424133611784958048_1374, duration: 64084
2013-10-31 16:18:45,195 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1424133611784958048_1374 terminating
2013-10-31 16:18:45,195 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36420, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1424133611784958048_1374, duration: 899017
2013-10-31 16:18:45,196 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1424133611784958048_1374 terminating
2013-10-31 16:18:45,196 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1424133611784958048_1374 size 116
2013-10-31 16:18:45,196 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56524, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1424133611784958048_1374, duration: 1736905
2013-10-31 16:18:45,197 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1424133611784958048_1374 size 116
2013-10-31 16:18:45,197 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1424133611784958048_1374 terminating
2013-10-31 16:18:45,200 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1424133611784958048_1374 size 116
2013-10-31 16:18:45,200 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken from client DFSClient_1457307213
2013-10-31 16:18:45,200 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken is closed by DFSClient_1457307213
2013-10-31 16:18:45,208 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken
2013-10-31 16:18:45,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:18:45,212 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56527, bytes: 187, op: HDFS_READ, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5130222379336307247_1370, duration: 270146
2013-10-31 16:18:45,213 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0032 = 83. Number of splits = 5
2013-10-31 16:18:45,214 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,214 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,214 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,215 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,215 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,215 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,215 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,217 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,217 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,217 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,217 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0032 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:18:45,218 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0032 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:18:45,344 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_4073126747153669157_1368 to datanode(s) 127.0.0.1:47311
2013-10-31 16:18:45,344 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-4541719979601510441_1363
2013-10-31 16:18:45,344 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-4541719979601510441_1363
2013-10-31 16:18:45,503 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4541719979601510441_1363 file build/test/data/dfs/data/data3/current/blk_-4541719979601510441 for deletion
2013-10-31 16:18:45,503 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4541719979601510441_1363 at file build/test/data/dfs/data/data3/current/blk_-4541719979601510441
2013-10-31 16:18:45,852 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0032_m_000006_0' to tip task_20131031160444934_0032_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:45,860 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:18:45,860 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000006_0 which needs 1 slots
2013-10-31 16:18:45,861 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000006_0 which needs 1 slots
2013-10-31 16:18:45,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken	dst=null	perm=null
2013-10-31 16:18:45,869 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49525, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1424133611784958048_1374, duration: 278968
2013-10-31 16:18:45,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml	dst=null	perm=null
2013-10-31 16:18:45,879 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36494, bytes: 29199, op: HDFS_READ, cliID: DFSClient_1914595330, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5302370728116882745_1371, duration: 384030
2013-10-31 16:18:45,910 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:45,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar	dst=null	perm=null
2013-10-31 16:18:45,937 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36495, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1914595330, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4073126747153669157_1368, duration: 1178927
2013-10-31 16:18:46,032 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0031_m_-1669483909
2013-10-31 16:18:46,036 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29530 with signal TERM. Exit code 0
2013-10-31 16:18:46,036 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_915869845
2013-10-31 16:18:46,037 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_915869845 spawned.
2013-10-31 16:18:46,040 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000006_0/taskjvm.sh
2013-10-31 16:18:46,153 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:46,153 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:46,153 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:46,154 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_-1669483909 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:47,799 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_915869845 given task: attempt_20131031160444934_0032_m_000006_0
2013-10-31 16:18:47,848 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0031
2013-10-31 16:18:47,848 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0031_m_000006_0 not found in cache
2013-10-31 16:18:47,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0031 for user-log deletion with retainTimeStamp:1383322727848
2013-10-31 16:18:47,848 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0031
2013-10-31 16:18:47,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0031 for user-log deletion with retainTimeStamp:1383322727849
2013-10-31 16:18:47,849 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0031
2013-10-31 16:18:47,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0031 for user-log deletion with retainTimeStamp:1383322727849
2013-10-31 16:18:47,903 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_4073126747153669157_1368 to 127.0.0.1:47311 
2013-10-31 16:18:47,903 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4541719979601510441_1363 file build/test/data/dfs/data/data2/current/blk_-4541719979601510441 for deletion
2013-10-31 16:18:47,904 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4541719979601510441_1363 at file build/test/data/dfs/data/data2/current/blk_-4541719979601510441
2013-10-31 16:18:47,904 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4073126747153669157_1368 src: /127.0.0.1:49530 dest: /127.0.0.1:47311
2013-10-31 16:18:47,904 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_4073126747153669157_1368 to /127.0.0.1:47311
2013-10-31 16:18:47,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_4073126747153669157_1368 src: /127.0.0.1:49530 dest: /127.0.0.1:47311 of size 238055
2013-10-31 16:18:47,907 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4073126747153669157_1368 size 238055
2013-10-31 16:18:48,133 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_r_-825662118 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,140 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29831 with signal TERM. Exit code 0
2013-10-31 16:18:48,288 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,289 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,289 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:48,289 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_r_-825662118 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:48,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:48,345 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-4541719979601510441_1363
2013-10-31 16:18:48,435 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_1249270322 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,448 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29580 with signal TERM. Exit code 0
2013-10-31 16:18:48,448 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_-2127491649 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,464 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29579 with signal TERM. Exit code 0
2013-10-31 16:18:48,621 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_-1457722047 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,627 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29651 with signal TERM. Exit code 0
2013-10-31 16:18:48,649 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_-1679966884 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,653 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29650 with signal TERM. Exit code 0
2013-10-31 16:18:48,659 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,659 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,659 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,659 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,659 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:48,659 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:48,660 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_1249270322 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:48,660 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_-2127491649 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:48,826 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,827 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,827 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:48,828 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_-1457722047 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:48,849 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,849 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,849 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:48,850 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_-1679966884 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:49,003 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_1525606085 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:49,012 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29352 with signal TERM. Exit code 0
2013-10-31 16:18:49,210 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:49,210 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:49,210 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:18:49,211 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_1525606085 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:18:51,114 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4541719979601510441_1363 file build/test/data/dfs/data/data7/current/blk_-4541719979601510441 for deletion
2013-10-31 16:18:51,115 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4541719979601510441_1363 at file build/test/data/dfs/data/data7/current/blk_-4541719979601510441
2013-10-31 16:18:51,225 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000006_0 0.0% setup
2013-10-31 16:18:51,228 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000006_0 is done.
2013-10-31 16:18:51,229 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000006_0  was -1
2013-10-31 16:18:51,229 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:51,905 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000006_0' has completed task_20131031160444934_0032_m_000006 successfully.
2013-10-31 16:18:51,909 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000000_0' to tip task_20131031160444934_0032_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:51,910 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000000
2013-10-31 16:18:51,910 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000001_0' to tip task_20131031160444934_0032_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:51,911 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000001
2013-10-31 16:18:51,913 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:18:51,914 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:18:51,914 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000000_0 which needs 1 slots
2013-10-31 16:18:51,915 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000000_0 which needs 1 slots
2013-10-31 16:18:51,915 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000001_0 which needs 1 slots
2013-10-31 16:18:51,915 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0032_m_000001_0 which needs 1 slots
2013-10-31 16:18:51,943 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000002_0' to tip task_20131031160444934_0032_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:18:51,943 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000002
2013-10-31 16:18:51,943 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000003_0' to tip task_20131031160444934_0032_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:18:51,944 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000003
2013-10-31 16:18:51,945 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:18:51,946 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:18:51,946 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000002_0 which needs 1 slots
2013-10-31 16:18:51,946 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000002_0 which needs 1 slots
2013-10-31 16:18:51,946 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000003_0 which needs 1 slots
2013-10-31 16:18:51,946 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0032_m_000003_0 which needs 1 slots
2013-10-31 16:18:51,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken	dst=null	perm=null
2013-10-31 16:18:51,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56535, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1424133611784958048_1374, duration: 141643
2013-10-31 16:18:51,953 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_-307560193
2013-10-31 16:18:51,953 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_-307560193 spawned.
2013-10-31 16:18:51,954 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0032/attempt_20131031160444934_0032_m_000001_0. Attempting to reuse: jvm_20131031160444934_0032_m_915869845
2013-10-31 16:18:51,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml	dst=null	perm=null
2013-10-31 16:18:51,955 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000000_0/taskjvm.sh
2013-10-31 16:18:51,956 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36501, bytes: 29199, op: HDFS_READ, cliID: DFSClient_487799539, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5302370728116882745_1371, duration: 160746
2013-10-31 16:18:52,030 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:52,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar	dst=null	perm=null
2013-10-31 16:18:52,058 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49536, bytes: 239915, op: HDFS_READ, cliID: DFSClient_487799539, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4073126747153669157_1368, duration: 1194008
2013-10-31 16:18:52,098 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_915869845 given task: attempt_20131031160444934_0032_m_000001_0
2013-10-31 16:18:52,147 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_2061442510
2013-10-31 16:18:52,148 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_2061442510 spawned.
2013-10-31 16:18:52,149 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_-1891823038
2013-10-31 16:18:52,149 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_-1891823038 spawned.
2013-10-31 16:18:52,150 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000002_0/taskjvm.sh
2013-10-31 16:18:52,150 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000003_0/taskjvm.sh
2013-10-31 16:18:52,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split	dst=null	perm=null
2013-10-31 16:18:52,434 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56541, bytes: 1773, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2094033281312644685_1369, duration: 163960
2013-10-31 16:18:52,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:52,473 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36506, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8193683770357719291_1366, duration: 100560
2013-10-31 16:18:52,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:52,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:52,889 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_-307560193 given task: attempt_20131031160444934_0032_m_000000_0
2013-10-31 16:18:52,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:52,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:52,918 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49541, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_863628976355473469_1367, duration: 124416
2013-10-31 16:18:52,928 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001. blk_5905163722231129390_1375
2013-10-31 16:18:52,944 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5905163722231129390_1375 src: /127.0.0.1:49542 dest: /127.0.0.1:47311
2013-10-31 16:18:52,945 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5905163722231129390_1375 src: /127.0.0.1:56546 dest: /127.0.0.1:41648
2013-10-31 16:18:52,946 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5905163722231129390_1375 src: /127.0.0.1:36442 dest: /127.0.0.1:50942
2013-10-31 16:18:52,949 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36442, dest: /127.0.0.1:50942, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5905163722231129390_1375, duration: 1658012
2013-10-31 16:18:52,949 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5905163722231129390_1375 terminating
2013-10-31 16:18:52,949 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5905163722231129390_1375 size 30
2013-10-31 16:18:52,949 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56546, dest: /127.0.0.1:41648, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5905163722231129390_1375, duration: 1766809
2013-10-31 16:18:52,949 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5905163722231129390_1375 terminating
2013-10-31 16:18:52,950 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49542, dest: /127.0.0.1:47311, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5905163722231129390_1375, duration: 2308719
2013-10-31 16:18:52,950 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5905163722231129390_1375 terminating
2013-10-31 16:18:52,951 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5905163722231129390_1375 size 30
2013-10-31 16:18:52,951 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5905163722231129390_1375 size 30
2013-10-31 16:18:52,952 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0032_m_000001_0
2013-10-31 16:18:52,952 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0032_m_000001_0
2013-10-31 16:18:52,996 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:52,997 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000001_0 0.0% 
2013-10-31 16:18:53,363 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_2061442510 given task: attempt_20131031160444934_0032_m_000002_0
2013-10-31 16:18:53,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split	dst=null	perm=null
2013-10-31 16:18:53,413 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49548, bytes: 1773, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2094033281312644685_1369, duration: 169791
2013-10-31 16:18:53,439 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_-1891823038 given task: attempt_20131031160444934_0032_m_000003_0
2013-10-31 16:18:53,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:53,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:53,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:53,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:53,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:53,701 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36516, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 129777
2013-10-31 16:18:53,705 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36517, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8193683770357719291_1366, duration: 100085
2013-10-31 16:18:53,714 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000. blk_7773255689976018768_1376
2013-10-31 16:18:53,738 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7773255689976018768_1376 src: /127.0.0.1:49551 dest: /127.0.0.1:47311
2013-10-31 16:18:53,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7773255689976018768_1376 src: /127.0.0.1:56555 dest: /127.0.0.1:41648
2013-10-31 16:18:53,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7773255689976018768_1376 src: /127.0.0.1:36451 dest: /127.0.0.1:50942
2013-10-31 16:18:53,741 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36451, dest: /127.0.0.1:50942, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7773255689976018768_1376, duration: 1164756
2013-10-31 16:18:53,742 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7773255689976018768_1376 terminating
2013-10-31 16:18:53,742 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56555, dest: /127.0.0.1:41648, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7773255689976018768_1376, duration: 1501426
2013-10-31 16:18:53,742 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7773255689976018768_1376 terminating
2013-10-31 16:18:53,742 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49551, dest: /127.0.0.1:47311, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7773255689976018768_1376, duration: 1983173
2013-10-31 16:18:53,743 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7773255689976018768_1376 terminating
2013-10-31 16:18:53,745 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7773255689976018768_1376 size 120
2013-10-31 16:18:53,746 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7773255689976018768_1376 size 120
2013-10-31 16:18:53,747 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7773255689976018768_1376 size 120
2013-10-31 16:18:53,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split	dst=null	perm=null
2013-10-31 16:18:53,887 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36523, bytes: 1257, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2094033281312644685_1369, duration: 209232
2013-10-31 16:18:53,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:53,926 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49557, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 100582
2013-10-31 16:18:53,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:53,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split	dst=null	perm=null
2013-10-31 16:18:53,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:53,952 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56561, bytes: 741, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2094033281312644685_1369, duration: 213189
2013-10-31 16:18:53,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:53,991 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56562, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 117899
2013-10-31 16:18:54,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:54,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:54,144 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0032_m_000000_0
2013-10-31 16:18:54,145 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0032_m_000000_0
2013-10-31 16:18:54,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:54,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:54,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56563, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 123463
2013-10-31 16:18:54,187 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0032_m_000002_0
2013-10-31 16:18:54,187 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0032_m_000002_0
2013-10-31 16:18:54,192 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:54,192 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000000_0 0.0% 
2013-10-31 16:18:54,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:54,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:54,230 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36528, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 154545
2013-10-31 16:18:54,231 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:54,232 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000002_0 0.0% 
2013-10-31 16:18:54,239 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0032_m_000003_0
2013-10-31 16:18:54,239 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0032_m_000003_0
2013-10-31 16:18:54,284 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:54,284 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000003_0 0.0% 
2013-10-31 16:18:54,868 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000004_0' to tip task_20131031160444934_0032_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:18:54,868 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000004
2013-10-31 16:18:54,871 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:18:54,871 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000004_0 which needs 1 slots
2013-10-31 16:18:54,871 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000004_0 which needs 1 slots
2013-10-31 16:18:54,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken	dst=null	perm=null
2013-10-31 16:18:54,880 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36461, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1424133611784958048_1374, duration: 333953
2013-10-31 16:18:54,880 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadBytes 68 raw values into 2 aggregated values, total 4
2013-10-31 16:18:54,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml	dst=null	perm=null
2013-10-31 16:18:54,891 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56568, bytes: 29199, op: HDFS_READ, cliID: DFSClient_-1146601161, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5302370728116882745_1371, duration: 420319
2013-10-31 16:18:54,917 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000000_0
2013-10-31 16:18:54,917 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000001_0
2013-10-31 16:18:54,918 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:54,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar	dst=null	perm=null
2013-10-31 16:18:54,951 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000002_0
2013-10-31 16:18:54,952 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000003_0
2013-10-31 16:18:54,953 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56569, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1146601161, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4073126747153669157_1368, duration: 1472240
2013-10-31 16:18:55,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0	dst=null	perm=null
2013-10-31 16:18:55,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:55,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:55,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0	dst=null	perm=null
2013-10-31 16:18:55,069 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_1107410354
2013-10-31 16:18:55,070 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_1107410354 spawned.
2013-10-31 16:18:55,072 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000004_0/taskjvm.sh
2013-10-31 16:18:55,398 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:20+20
2013-10-31 16:18:55,399 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000001_0 is done.
2013-10-31 16:18:55,399 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000001_0  was -1
2013-10-31 16:18:55,399 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:56,915 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0032_m_000006_0
2013-10-31 16:18:56,915 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0032_m_000006_0
2013-10-31 16:18:56,915 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000006_0 not found in cache
2013-10-31 16:18:56,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0	dst=null	perm=null
2013-10-31 16:18:56,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0	dst=null	perm=null
2013-10-31 16:18:56,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0	dst=null	perm=null
2013-10-31 16:18:56,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:56,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:56,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:57,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:57,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:57,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:57,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0	dst=null	perm=null
2013-10-31 16:18:57,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0	dst=null	perm=null
2013-10-31 16:18:57,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0	dst=null	perm=null
2013-10-31 16:18:57,807 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_1107410354 given task: attempt_20131031160444934_0032_m_000004_0
2013-10-31 16:18:57,919 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000001_0' has completed task_20131031160444934_0032_m_000001 successfully.
2013-10-31 16:18:58,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split	dst=null	perm=null
2013-10-31 16:18:58,296 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36536, bytes: 741, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2094033281312644685_1369, duration: 251171
2013-10-31 16:18:58,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:58,335 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49570, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 253159
2013-10-31 16:18:58,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:58,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:58,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:58,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:18:58,599 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49571, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_863628976355473469_1367, duration: 136924
2013-10-31 16:18:58,611 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004. blk_-223779029298134025_1379
2013-10-31 16:18:58,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-223779029298134025_1379 src: /127.0.0.1:49572 dest: /127.0.0.1:47311
2013-10-31 16:18:58,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-223779029298134025_1379 src: /127.0.0.1:56576 dest: /127.0.0.1:41648
2013-10-31 16:18:58,655 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-223779029298134025_1379 src: /127.0.0.1:36472 dest: /127.0.0.1:50942
2013-10-31 16:18:58,657 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36472, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-223779029298134025_1379, duration: 1302164
2013-10-31 16:18:58,657 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-223779029298134025_1379 terminating
2013-10-31 16:18:58,657 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56576, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-223779029298134025_1379, duration: 1450116
2013-10-31 16:18:58,658 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-223779029298134025_1379 terminating
2013-10-31 16:18:58,658 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49572, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-223779029298134025_1379, duration: 1929462
2013-10-31 16:18:58,658 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-223779029298134025_1379 size 8
2013-10-31 16:18:58,658 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-223779029298134025_1379 terminating
2013-10-31 16:18:58,659 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0032_m_000004_0
2013-10-31 16:18:58,660 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0032_m_000004_0
2013-10-31 16:18:58,661 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-223779029298134025_1379 size 8
2013-10-31 16:18:58,662 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-223779029298134025_1379 size 8
2013-10-31 16:18:58,731 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:58,731 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000004_0 0.0% 
2013-10-31 16:18:59,399 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:0+20
2013-10-31 16:18:59,408 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:0+20
2013-10-31 16:18:59,409 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000000_0 is done.
2013-10-31 16:18:59,409 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000000_0  was -1
2013-10-31 16:18:59,409 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:59,847 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:40+20
2013-10-31 16:18:59,851 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:40+20
2013-10-31 16:18:59,852 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000002_0 is done.
2013-10-31 16:18:59,852 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000002_0  was -1
2013-10-31 16:18:59,853 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:59,912 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:60+20
2013-10-31 16:18:59,916 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:60+20
2013-10-31 16:18:59,916 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000003_0 is done.
2013-10-31 16:18:59,916 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000003_0  was -1
2013-10-31 16:18:59,917 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:00,877 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000004_0
2013-10-31 16:19:00,923 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000000_0' has completed task_20131031160444934_0032_m_000000 successfully.
2013-10-31 16:19:00,956 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000002_0' has completed task_20131031160444934_0032_m_000002 successfully.
2013-10-31 16:19:00,957 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000003_0' has completed task_20131031160444934_0032_m_000003 successfully.
2013-10-31 16:19:01,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0	dst=null	perm=null
2013-10-31 16:19:01,750 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2021 Total time for transactions(ms): 43Number of transactions batched in Syncs: 224 Number of syncs: 1449 SyncTimes(ms): 66889 13760 
2013-10-31 16:19:01,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:01,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:01,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0	dst=null	perm=null
2013-10-31 16:19:02,084 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3172384662314539439_1009
2013-10-31 16:19:04,297 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:80+3
2013-10-31 16:19:04,299 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:80+3
2013-10-31 16:19:04,299 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000004_0 is done.
2013-10-31 16:19:04,300 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000004_0  was -1
2013-10-31 16:19:04,300 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:06,884 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000004_0' has completed task_20131031160444934_0032_m_000004 successfully.
2013-10-31 16:19:06,887 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0032_m_000005_0' to tip task_20131031160444934_0032_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:19:06,890 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:19:06,890 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000005_0 which needs 1 slots
2013-10-31 16:19:06,890 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000005_0 which needs 1 slots
2013-10-31 16:19:06,929 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_1898439609
2013-10-31 16:19:06,930 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_1898439609 spawned.
2013-10-31 16:19:06,933 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000005_0/taskjvm.sh
2013-10-31 16:19:07,825 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_1898439609 given task: attempt_20131031160444934_0032_m_000005_0
2013-10-31 16:19:08,353 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000005_0 0.0% 
2013-10-31 16:19:08,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary	dst=null	perm=null
2013-10-31 16:19:08,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:08,377 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_SUCCESS from client DFSClient_attempt_20131031160444934_0032_m_000005_0
2013-10-31 16:19:08,377 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0032_m_000005_0
2013-10-31 16:19:08,384 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4073126747153669157 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:08,384 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4073126747153669157 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:08,384 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4073126747153669157 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:08,384 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4073126747153669157 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:08,385 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2094033281312644685 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:08,385 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2094033281312644685 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:08,385 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2094033281312644685 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:08,385 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2094033281312644685 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:08,385 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5130222379336307247 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:08,386 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5130222379336307247 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:08,386 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5130222379336307247 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:08,386 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5302370728116882745 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:08,386 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5302370728116882745 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:08,387 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5302370728116882745 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:08,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032	dst=null	perm=null
2013-10-31 16:19:09,348 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_5130222379336307247_1370 blk_-5302370728116882745_1371 blk_4073126747153669157_1368 blk_2094033281312644685_1369
2013-10-31 16:19:09,349 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_5130222379336307247_1370 blk_4073126747153669157_1368 blk_2094033281312644685_1369
2013-10-31 16:19:09,511 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2094033281312644685_1369 file build/test/data/dfs/data/data4/current/blk_2094033281312644685 for deletion
2013-10-31 16:19:09,511 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4073126747153669157_1368 file build/test/data/dfs/data/data4/current/blk_4073126747153669157 for deletion
2013-10-31 16:19:09,511 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2094033281312644685_1369 at file build/test/data/dfs/data/data4/current/blk_2094033281312644685
2013-10-31 16:19:09,512 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5130222379336307247_1370 file build/test/data/dfs/data/data3/current/blk_5130222379336307247 for deletion
2013-10-31 16:19:09,512 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4073126747153669157_1368 at file build/test/data/dfs/data/data4/current/blk_4073126747153669157
2013-10-31 16:19:09,512 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5130222379336307247_1370 at file build/test/data/dfs/data/data3/current/blk_5130222379336307247
2013-10-31 16:19:11,266 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000005_0 0.0% cleanup
2013-10-31 16:19:11,267 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000005_0 is done.
2013-10-31 16:19:11,268 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000005_0  was -1
2013-10-31 16:19:11,268 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:12,122 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5302370728116882745_1371 file build/test/data/dfs/data/data8/current/blk_-5302370728116882745 for deletion
2013-10-31 16:19:12,122 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2094033281312644685_1369 file build/test/data/dfs/data/data8/current/blk_2094033281312644685 for deletion
2013-10-31 16:19:12,122 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5302370728116882745_1371 at file build/test/data/dfs/data/data8/current/blk_-5302370728116882745
2013-10-31 16:19:12,122 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4073126747153669157_1368 file build/test/data/dfs/data/data7/current/blk_4073126747153669157 for deletion
2013-10-31 16:19:12,123 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2094033281312644685_1369 at file build/test/data/dfs/data/data8/current/blk_2094033281312644685
2013-10-31 16:19:12,123 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5130222379336307247_1370 file build/test/data/dfs/data/data7/current/blk_5130222379336307247 for deletion
2013-10-31 16:19:12,123 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4073126747153669157_1368 at file build/test/data/dfs/data/data7/current/blk_4073126747153669157
2013-10-31 16:19:12,124 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5130222379336307247_1370 at file build/test/data/dfs/data/data7/current/blk_5130222379336307247
2013-10-31 16:19:12,349 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_5130222379336307247_1370 blk_-5302370728116882745_1371 blk_4073126747153669157_1368 blk_2094033281312644685_1369
2013-10-31 16:19:12,349 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5302370728116882745_1371 blk_4073126747153669157_1368 blk_2094033281312644685_1369
2013-10-31 16:19:12,897 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000005_0' has completed task_20131031160444934_0032_m_000005 successfully.
2013-10-31 16:19:12,898 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0032 has completed successfully.
2013-10-31 16:19:12,898 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0032,submitTime=1383236325095,launchTime=1383236325217,firstMapTaskLaunchTime=1383236331908,firstJobSetupTaskLaunchTime=1383236325851,firstJobCleanupTaskLaunchTime=1383236346887,finishTime=1383236352898,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[00C6855187034102BD14C2CB0C62BC51/A7F8D74902DE4FF6A54887383F7C0872] lower*upper/(1/1) ...edpipesplatform/joininner
2013-10-31 16:19:12,903 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6. blk_-1306360006653944798_1380
2013-10-31 16:19:12,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1306360006653944798_1380 src: /127.0.0.1:56582 dest: /127.0.0.1:41648
2013-10-31 16:19:12,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1306360006653944798_1380 src: /127.0.0.1:36547 dest: /127.0.0.1:38271
2013-10-31 16:19:12,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1306360006653944798_1380 src: /127.0.0.1:36479 dest: /127.0.0.1:50942
2013-10-31 16:19:12,921 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36479, dest: /127.0.0.1:50942, bytes: 25792, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1306360006653944798_1380, duration: 5823843
2013-10-31 16:19:12,922 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1306360006653944798_1380 terminating
2013-10-31 16:19:12,922 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1306360006653944798_1380 size 25792
2013-10-31 16:19:12,922 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36547, dest: /127.0.0.1:38271, bytes: 25792, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1306360006653944798_1380, duration: 5501042
2013-10-31 16:19:12,923 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1306360006653944798_1380 size 25792
2013-10-31 16:19:12,923 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1306360006653944798_1380 terminating
2013-10-31 16:19:12,923 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56582, dest: /127.0.0.1:41648, bytes: 25792, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1306360006653944798_1380, duration: 4425234
2013-10-31 16:19:12,924 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1306360006653944798_1380 terminating
2013-10-31 16:19:12,930 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1306360006653944798_1380 size 25792
2013-10-31 16:19:12,930 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6 from client DFSClient_-519505853
2013-10-31 16:19:12,930 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6 is closed by DFSClient_-519505853
2013-10-31 16:19:12,939 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:19:12,940 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000004_0'
2013-10-31 16:19:12,941 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000005_0'
2013-10-31 16:19:12,942 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000000_0'
2013-10-31 16:19:12,942 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1424133611784958048 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:12,942 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000001_0'
2013-10-31 16:19:12,943 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1424133611784958048 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:12,943 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000006_0'
2013-10-31 16:19:12,943 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1424133611784958048 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:12,945 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0032_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:19:12,950 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary
2013-10-31 16:19:12,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032	dst=null	perm=null
2013-10-31 16:19:12,971 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000002_0'
2013-10-31 16:19:12,972 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000003_0'
2013-10-31 16:19:13,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner	dst=null	perm=null
2013-10-31 16:19:13,009 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:19:13,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2013-10-31 16:19:13,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2013-10-31 16:19:13,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2013-10-31 16:19:13,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2013-10-31 16:19:13,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2013-10-31 16:19:13,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2013-10-31 16:19:13,022 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56586, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7773255689976018768_1376, duration: 283836
2013-10-31 16:19:13,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2013-10-31 16:19:13,026 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36482, bytes: 34, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5905163722231129390_1375, duration: 257543
2013-10-31 16:19:13,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2013-10-31 16:19:13,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2013-10-31 16:19:13,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2013-10-31 16:19:13,032 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56588, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-223779029298134025_1379, duration: 261917
2013-10-31 16:19:13,049 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner	dst=null	perm=null
2013-10-31 16:19:13,050 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:19:13,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2013-10-31 16:19:13,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2013-10-31 16:19:13,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2013-10-31 16:19:13,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2013-10-31 16:19:13,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2013-10-31 16:19:13,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2013-10-31 16:19:13,059 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56589, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7773255689976018768_1376, duration: 255498
2013-10-31 16:19:13,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2013-10-31 16:19:13,063 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56590, bytes: 34, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5905163722231129390_1375, duration: 253396
2013-10-31 16:19:13,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2013-10-31 16:19:13,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2013-10-31 16:19:13,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2013-10-31 16:19:13,069 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56591, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-223779029298134025_1379, duration: 262037
2013-10-31 16:19:13,069 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joininner
2013-10-31 16:19:13,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner	dst=null	perm=null
2013-10-31 16:19:13,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2013-10-31 16:19:13,077 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36487, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7773255689976018768_1376, duration: 254389
2013-10-31 16:19:13,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2013-10-31 16:19:13,082 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36488, bytes: 34, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5905163722231129390_1375, duration: 259799
2013-10-31 16:19:13,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2013-10-31 16:19:13,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2013-10-31 16:19:13,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2013-10-31 16:19:13,091 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36489, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-223779029298134025_1379, duration: 305689
2013-10-31 16:19:13,111 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:19:13,112 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:19:13,128 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5302370728116882745_1371 file build/test/data/dfs/data/data6/current/blk_-5302370728116882745 for deletion
2013-10-31 16:19:13,128 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2094033281312644685_1369 file build/test/data/dfs/data/data6/current/blk_2094033281312644685 for deletion
2013-10-31 16:19:13,128 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4073126747153669157_1368 file build/test/data/dfs/data/data5/current/blk_4073126747153669157 for deletion
2013-10-31 16:19:13,129 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5302370728116882745_1371 at file build/test/data/dfs/data/data6/current/blk_-5302370728116882745
2013-10-31 16:19:13,129 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5130222379336307247_1370 file build/test/data/dfs/data/data5/current/blk_5130222379336307247 for deletion
2013-10-31 16:19:13,129 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4073126747153669157_1368 at file build/test/data/dfs/data/data5/current/blk_4073126747153669157
2013-10-31 16:19:13,129 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2094033281312644685_1369 at file build/test/data/dfs/data/data6/current/blk_2094033281312644685
2013-10-31 16:19:13,129 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5130222379336307247_1370 at file build/test/data/dfs/data/data5/current/blk_5130222379336307247
2013-10-31 16:19:13,136 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] starting
2013-10-31 16:19:13,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:19:13,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby"]
2013-10-31 16:19:13,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  parallel execution is enabled: true
2013-10-31 16:19:13,138 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  starting jobs: 2
2013-10-31 16:19:13,138 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs]  allocating threads: 2
2013-10-31 16:19:13,139 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] starting step: (2/2)
2013-10-31 16:19:13,143 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:19:13,143 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:19:13,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:13,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:19:13,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:13,164 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar. blk_-453853160008994316_1381
2013-10-31 16:19:13,165 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-453853160008994316_1381 src: /127.0.0.1:36490 dest: /127.0.0.1:50942
2013-10-31 16:19:13,166 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-453853160008994316_1381 src: /127.0.0.1:56596 dest: /127.0.0.1:41648
2013-10-31 16:19:13,168 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-453853160008994316_1381 src: /127.0.0.1:49594 dest: /127.0.0.1:47311
2013-10-31 16:19:13,176 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49594, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-453853160008994316_1381, duration: 3717889
2013-10-31 16:19:13,176 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-453853160008994316_1381 terminating
2013-10-31 16:19:13,177 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56596, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-453853160008994316_1381, duration: 4531075
2013-10-31 16:19:13,177 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-453853160008994316_1381 terminating
2013-10-31 16:19:13,178 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36490, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-453853160008994316_1381, duration: 5708946
2013-10-31 16:19:13,178 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-453853160008994316_1381 terminating
2013-10-31 16:19:13,180 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-453853160008994316_1381 size 238055
2013-10-31 16:19:13,180 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar from client DFSClient_1457307213
2013-10-31 16:19:13,180 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar is closed by DFSClient_1457307213
2013-10-31 16:19:13,181 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-453853160008994316_1381 size 238055
2013-10-31 16:19:13,181 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-453853160008994316_1381 size 238055
2013-10-31 16:19:13,187 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar. New replication is 10
2013-10-31 16:19:14,913 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5302370728116882745_1371 file build/test/data/dfs/data/data2/current/blk_-5302370728116882745 for deletion
2013-10-31 16:19:14,913 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2094033281312644685_1369 file build/test/data/dfs/data/data1/current/blk_2094033281312644685 for deletion
2013-10-31 16:19:14,913 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5302370728116882745_1371 at file build/test/data/dfs/data/data2/current/blk_-5302370728116882745
2013-10-31 16:19:14,914 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2094033281312644685_1369 at file build/test/data/dfs/data/data1/current/blk_2094033281312644685
2013-10-31 16:19:14,913 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4073126747153669157_1368 file build/test/data/dfs/data/data2/current/blk_4073126747153669157 for deletion
2013-10-31 16:19:14,915 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4073126747153669157_1368 at file build/test/data/dfs/data/data2/current/blk_4073126747153669157
2013-10-31 16:19:15,350 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-453853160008994316_1381 to datanode(s) 127.0.0.1:38271
2013-10-31 16:19:15,351 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_1424133611784958048_1374
2013-10-31 16:19:15,351 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_1424133611784958048_1374
2013-10-31 16:19:15,513 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1424133611784958048_1374 file build/test/data/dfs/data/data3/current/blk_1424133611784958048 for deletion
2013-10-31 16:19:15,513 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1424133611784958048_1374 at file build/test/data/dfs/data/data3/current/blk_1424133611784958048
2013-10-31 16:19:15,893 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0032
2013-10-31 16:19:15,894 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0032 being deleted.
2013-10-31 16:19:16,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar	dst=null	perm=null
2013-10-31 16:19:16,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,531 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:19:16,536 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:19:16,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:19:16,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,551 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split. New replication is 10
2013-10-31 16:19:16,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split	dst=null	perm=null
2013-10-31 16:19:16,560 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split. blk_777667023145340875_1382
2013-10-31 16:19:16,562 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777667023145340875_1382 src: /127.0.0.1:36493 dest: /127.0.0.1:50942
2013-10-31 16:19:16,564 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777667023145340875_1382 src: /127.0.0.1:36563 dest: /127.0.0.1:38271
2013-10-31 16:19:16,566 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777667023145340875_1382 src: /127.0.0.1:49597 dest: /127.0.0.1:47311
2013-10-31 16:19:16,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777667023145340875_1382 src: /127.0.0.1:56601 dest: /127.0.0.1:41648
2013-10-31 16:19:16,571 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56601, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777667023145340875_1382, duration: 228981
2013-10-31 16:19:16,571 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_777667023145340875_1382 terminating
2013-10-31 16:19:16,571 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_777667023145340875_1382 size 1732
2013-10-31 16:19:16,572 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49597, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_777667023145340875_1382, duration: 1046494
2013-10-31 16:19:16,572 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_777667023145340875_1382 size 1732
2013-10-31 16:19:16,573 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_777667023145340875_1382 terminating
2013-10-31 16:19:16,573 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36563, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_777667023145340875_1382, duration: 2580609
2013-10-31 16:19:16,574 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_777667023145340875_1382 terminating
2013-10-31 16:19:16,574 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36493, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777667023145340875_1382, duration: 3401237
2013-10-31 16:19:16,575 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_777667023145340875_1382 terminating
2013-10-31 16:19:16,576 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_777667023145340875_1382 size 1732
2013-10-31 16:19:16,576 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split from client DFSClient_1457307213
2013-10-31 16:19:16,577 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split is closed by DFSClient_1457307213
2013-10-31 16:19:16,577 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_777667023145340875_1382 size 1732
2013-10-31 16:19:16,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,604 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo. blk_1600864550067754613_1383
2013-10-31 16:19:16,606 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1600864550067754613_1383 src: /127.0.0.1:36497 dest: /127.0.0.1:50942
2013-10-31 16:19:16,608 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1600864550067754613_1383 src: /127.0.0.1:36567 dest: /127.0.0.1:38271
2013-10-31 16:19:16,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1600864550067754613_1383 src: /127.0.0.1:56604 dest: /127.0.0.1:41648
2013-10-31 16:19:16,612 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56604, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1600864550067754613_1383, duration: 80176
2013-10-31 16:19:16,613 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1600864550067754613_1383 terminating
2013-10-31 16:19:16,613 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36567, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1600864550067754613_1383, duration: 1174563
2013-10-31 16:19:16,614 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1600864550067754613_1383 terminating
2013-10-31 16:19:16,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36497, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1600864550067754613_1383, duration: 1986509
2013-10-31 16:19:16,615 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1600864550067754613_1383 size 183
2013-10-31 16:19:16,615 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1600864550067754613_1383 terminating
2013-10-31 16:19:16,617 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1600864550067754613_1383 size 183
2013-10-31 16:19:16,617 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:19:16,618 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:19:16,618 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1600864550067754613_1383 size 183
2013-10-31 16:19:16,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,651 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml. blk_-7933150028582980354_1384
2013-10-31 16:19:16,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7933150028582980354_1384 src: /127.0.0.1:36500 dest: /127.0.0.1:50942
2013-10-31 16:19:16,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7933150028582980354_1384 src: /127.0.0.1:36570 dest: /127.0.0.1:38271
2013-10-31 16:19:16,656 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7933150028582980354_1384 src: /127.0.0.1:56607 dest: /127.0.0.1:41648
2013-10-31 16:19:16,659 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56607, dest: /127.0.0.1:41648, bytes: 28207, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7933150028582980354_1384, duration: 174226
2013-10-31 16:19:16,659 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7933150028582980354_1384 terminating
2013-10-31 16:19:16,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36570, dest: /127.0.0.1:38271, bytes: 28207, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7933150028582980354_1384, duration: 1033470
2013-10-31 16:19:16,660 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7933150028582980354_1384 terminating
2013-10-31 16:19:16,660 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7933150028582980354_1384 size 28207
2013-10-31 16:19:16,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36500, dest: /127.0.0.1:50942, bytes: 28207, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7933150028582980354_1384, duration: 1890890
2013-10-31 16:19:16,661 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7933150028582980354_1384 terminating
2013-10-31 16:19:16,661 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7933150028582980354_1384 size 28207
2013-10-31 16:19:16,663 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml from client DFSClient_1457307213
2013-10-31 16:19:16,663 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml is closed by DFSClient_1457307213
2013-10-31 16:19:16,663 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7933150028582980354_1384 size 28207
2013-10-31 16:19:16,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml	dst=null	perm=null
2013-10-31 16:19:16,679 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36504, bytes: 28431, op: HDFS_READ, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7933150028582980354_1384, duration: 398415
2013-10-31 16:19:16,698 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0033: nMaps=5 nReduces=1 max=-1
2013-10-31 16:19:16,698 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0033 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:19:16,698 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0033	RESULT=SUCCESS
2013-10-31 16:19:16,698 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0033
2013-10-31 16:19:16,699 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0033
2013-10-31 16:19:16,699 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] submitted hadoop job: job_20131031160444934_0033
2013-10-31 16:19:16,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,730 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_conf.xml. blk_-499582711603059738_1386
2013-10-31 16:19:16,732 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-499582711603059738_1386 src: /127.0.0.1:49607 dest: /127.0.0.1:47311
2013-10-31 16:19:16,733 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-499582711603059738_1386 src: /127.0.0.1:56611 dest: /127.0.0.1:41648
2013-10-31 16:19:16,735 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-499582711603059738_1386 src: /127.0.0.1:36507 dest: /127.0.0.1:50942
2013-10-31 16:19:16,739 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36507, dest: /127.0.0.1:50942, bytes: 28272, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-499582711603059738_1386, duration: 601056
2013-10-31 16:19:16,740 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-499582711603059738_1386 terminating
2013-10-31 16:19:16,740 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56611, dest: /127.0.0.1:41648, bytes: 28272, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-499582711603059738_1386, duration: 1421807
2013-10-31 16:19:16,741 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-499582711603059738_1386 terminating
2013-10-31 16:19:16,741 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-499582711603059738_1386 size 28272
2013-10-31 16:19:16,741 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49607, dest: /127.0.0.1:47311, bytes: 28272, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-499582711603059738_1386, duration: 2380050
2013-10-31 16:19:16,742 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-499582711603059738_1386 terminating
2013-10-31 16:19:16,742 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-499582711603059738_1386 size 28272
2013-10-31 16:19:16,744 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_conf.xml from client DFSClient_1812894713
2013-10-31 16:19:16,744 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_conf.xml is closed by DFSClient_1812894713
2013-10-31 16:19:16,745 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-499582711603059738_1386 size 28272
2013-10-31 16:19:16,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,757 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken. blk_3881077061080299198_1387
2013-10-31 16:19:16,759 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3881077061080299198_1387 src: /127.0.0.1:36508 dest: /127.0.0.1:50942
2013-10-31 16:19:16,760 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3881077061080299198_1387 src: /127.0.0.1:36578 dest: /127.0.0.1:38271
2013-10-31 16:19:16,762 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3881077061080299198_1387 src: /127.0.0.1:56615 dest: /127.0.0.1:41648
2013-10-31 16:19:16,765 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56615, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3881077061080299198_1387, duration: 64891
2013-10-31 16:19:16,765 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3881077061080299198_1387 terminating
2013-10-31 16:19:16,766 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36578, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3881077061080299198_1387, duration: 777958
2013-10-31 16:19:16,766 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3881077061080299198_1387 terminating
2013-10-31 16:19:16,767 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3881077061080299198_1387 size 116
2013-10-31 16:19:16,767 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36508, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3881077061080299198_1387, duration: 1718404
2013-10-31 16:19:16,767 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3881077061080299198_1387 terminating
2013-10-31 16:19:16,769 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken from client DFSClient_1457307213
2013-10-31 16:19:16,769 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken is closed by DFSClient_1457307213
2013-10-31 16:19:16,770 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3881077061080299198_1387 size 116
2013-10-31 16:19:16,771 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3881077061080299198_1387 size 116
2013-10-31 16:19:16,775 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken
2013-10-31 16:19:16,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:19:16,779 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56616, bytes: 187, op: HDFS_READ, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1600864550067754613_1383, duration: 272282
2013-10-31 16:19:16,780 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0033 = 19. Number of splits = 5
2013-10-31 16:19:16,781 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,781 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,781 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,781 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,782 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,782 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,782 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,782 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,783 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,783 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,783 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,783 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,784 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,784 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,784 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,784 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0033 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:19:16,785 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0033 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:19:17,942 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0032
2013-10-31 16:19:17,943 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000004_0 not found in cache
2013-10-31 16:19:17,943 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000005_0 not found in cache
2013-10-31 16:19:17,944 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0032 for user-log deletion with retainTimeStamp:1383322757943
2013-10-31 16:19:17,972 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0032
2013-10-31 16:19:17,972 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000001_0 not found in cache
2013-10-31 16:19:17,972 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000000_0 not found in cache
2013-10-31 16:19:17,973 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0032 for user-log deletion with retainTimeStamp:1383322757973
2013-10-31 16:19:18,011 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0032
2013-10-31 16:19:18,011 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000003_0 not found in cache
2013-10-31 16:19:18,012 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000002_0 not found in cache
2013-10-31 16:19:18,012 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0032 for user-log deletion with retainTimeStamp:1383322758012
2013-10-31 16:19:18,125 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-453853160008994316_1381 to 127.0.0.1:38271 
2013-10-31 16:19:18,125 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1424133611784958048_1374 file build/test/data/dfs/data/data8/current/blk_1424133611784958048 for deletion
2013-10-31 16:19:18,126 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1424133611784958048_1374 at file build/test/data/dfs/data/data8/current/blk_1424133611784958048
2013-10-31 16:19:18,127 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-453853160008994316_1381 src: /127.0.0.1:36581 dest: /127.0.0.1:38271
2013-10-31 16:19:18,127 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-453853160008994316_1381 to /127.0.0.1:38271
2013-10-31 16:19:18,130 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-453853160008994316_1381 src: /127.0.0.1:36581 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:19:18,131 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-453853160008994316_1381 size 238055
2013-10-31 16:19:18,340 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_1107410354 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:18,351 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30496 with signal TERM. Exit code 0
2013-10-31 16:19:18,351 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_1424133611784958048_1374
2013-10-31 16:19:18,423 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_2061442510 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:18,432 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30317 with signal TERM. Exit code 0
2013-10-31 16:19:18,477 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_-1891823038 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:18,484 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30347 with signal TERM. Exit code 0
2013-10-31 16:19:18,512 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:18,512 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:18,512 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:18,512 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_1107410354 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:18,552 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_915869845 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:18,556 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30093 with signal TERM. Exit code 0
2013-10-31 16:19:18,898 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0033_m_000006_0' to tip task_20131031160444934_0033_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:18,903 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:19:18,904 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000006_0 which needs 1 slots
2013-10-31 16:19:18,904 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000006_0 which needs 1 slots
2013-10-31 16:19:18,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken	dst=null	perm=null
2013-10-31 16:19:18,920 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36513, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3881077061080299198_1387, duration: 293620
2013-10-31 16:19:18,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml	dst=null	perm=null
2013-10-31 16:19:18,930 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36584, bytes: 28431, op: HDFS_READ, cliID: DFSClient_-1445678719, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7933150028582980354_1384, duration: 382701
2013-10-31 16:19:19,107 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:19:19,130 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1424133611784958048_1374 file build/test/data/dfs/data/data5/current/blk_1424133611784958048 for deletion
2013-10-31 16:19:19,130 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,130 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,130 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,131 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,131 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:19,131 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,131 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_-1891823038 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:19,131 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:19,130 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,131 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:19,130 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1424133611784958048_1374 at file build/test/data/dfs/data/data5/current/blk_1424133611784958048
2013-10-31 16:19:19,132 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_915869845 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:19:19,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar	dst=null	perm=null
2013-10-31 16:19:19,131 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_2061442510 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:19,134 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36516, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1445678719, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-453853160008994316_1381, duration: 598998
2013-10-31 16:19:19,214 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_-1126263002
2013-10-31 16:19:19,215 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_-1126263002 spawned.
2013-10-31 16:19:19,216 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000006_0/taskjvm.sh
2013-10-31 16:19:19,330 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_1898439609 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:19,340 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30588 with signal TERM. Exit code 0
2013-10-31 16:19:19,460 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_-307560193 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:19,464 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30266 with signal TERM. Exit code 0
2013-10-31 16:19:19,504 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,504 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,504 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:19,504 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_1898439609 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:19,620 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,620 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,620 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:19,620 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_-307560193 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:21,534 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-1126263002 given task: attempt_20131031160444934_0033_m_000006_0
2013-10-31 16:19:22,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:25,009 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000006_0 0.0% setup
2013-10-31 16:19:25,012 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000006_0 is done.
2013-10-31 16:19:25,012 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000006_0  was -1
2013-10-31 16:19:25,012 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:27,914 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000006_0' has completed task_20131031160444934_0033_m_000006 successfully.
2013-10-31 16:19:27,918 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000000_0' to tip task_20131031160444934_0033_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:27,919 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000000
2013-10-31 16:19:27,920 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000001_0' to tip task_20131031160444934_0033_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:27,920 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000001
2013-10-31 16:19:27,922 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:19:27,923 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:19:27,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000000_0 which needs 1 slots
2013-10-31 16:19:27,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000000_0 which needs 1 slots
2013-10-31 16:19:27,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000001_0 which needs 1 slots
2013-10-31 16:19:27,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0033_m_000001_0 which needs 1 slots
2013-10-31 16:19:27,958 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000002_0' to tip task_20131031160444934_0033_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:19:27,958 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000002
2013-10-31 16:19:27,958 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000003_0' to tip task_20131031160444934_0033_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:19:27,959 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000003
2013-10-31 16:19:27,960 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:19:27,960 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:19:27,960 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000002_0 which needs 1 slots
2013-10-31 16:19:27,960 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000002_0 which needs 1 slots
2013-10-31 16:19:27,960 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000003_0 which needs 1 slots
2013-10-31 16:19:27,961 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0033_m_000003_0 which needs 1 slots
2013-10-31 16:19:27,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken	dst=null	perm=null
2013-10-31 16:19:27,966 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_-1857432135
2013-10-31 16:19:27,967 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_-1857432135 spawned.
2013-10-31 16:19:27,968 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36588, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3881077061080299198_1387, duration: 303982
2013-10-31 16:19:27,968 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000000_0/taskjvm.sh
2013-10-31 16:19:27,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml	dst=null	perm=null
2013-10-31 16:19:27,976 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56626, bytes: 28431, op: HDFS_READ, cliID: DFSClient_1653635854, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7933150028582980354_1384, duration: 185654
2013-10-31 16:19:27,983 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0033/attempt_20131031160444934_0033_m_000001_0. Attempting to reuse: jvm_20131031160444934_0033_m_-1126263002
2013-10-31 16:19:27,988 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000004_0' to tip task_20131031160444934_0033_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:19:27,988 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000004
2013-10-31 16:19:27,989 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:19:27,989 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:19:27,990 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000004_0 which needs 1 slots
2013-10-31 16:19:27,990 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000004_0 which needs 1 slots
2013-10-31 16:19:27,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken	dst=null	perm=null
2013-10-31 16:19:27,997 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56627, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3881077061080299198_1387, duration: 270959
2013-10-31 16:19:28,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar	dst=null	perm=null
2013-10-31 16:19:28,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml	dst=null	perm=null
2013-10-31 16:19:28,007 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36524, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1653635854, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-453853160008994316_1381, duration: 650898
2013-10-31 16:19:28,009 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36525, bytes: 28431, op: HDFS_READ, cliID: DFSClient_-1227566731, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7933150028582980354_1384, duration: 377501
2013-10-31 16:19:28,032 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:19:28,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar	dst=null	perm=null
2013-10-31 16:19:28,048 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56631, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1227566731, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-453853160008994316_1381, duration: 598242
2013-10-31 16:19:28,059 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_-357406308
2013-10-31 16:19:28,060 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_-357406308 spawned.
2013-10-31 16:19:28,060 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_-426699948
2013-10-31 16:19:28,061 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_-426699948 spawned.
2013-10-31 16:19:28,062 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000002_0/taskjvm.sh
2013-10-31 16:19:28,062 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000003_0/taskjvm.sh
2013-10-31 16:19:28,406 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_824648574
2013-10-31 16:19:28,406 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_824648574 spawned.
2013-10-31 16:19:28,407 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000004_0/taskjvm.sh
2013-10-31 16:19:28,579 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-1126263002 given task: attempt_20131031160444934_0033_m_000001_0
2013-10-31 16:19:28,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split	dst=null	perm=null
2013-10-31 16:19:28,762 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36598, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_777667023145340875_1382, duration: 167230
2013-10-31 16:19:28,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:19:28,805 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36530, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 264515
2013-10-31 16:19:28,808 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-1857432135 given task: attempt_20131031160444934_0033_m_000000_0
2013-10-31 16:19:29,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split	dst=null	perm=null
2013-10-31 16:19:29,347 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36602, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_777667023145340875_1382, duration: 174703
2013-10-31 16:19:29,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:19:29,440 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-357406308 given task: attempt_20131031160444934_0033_m_000002_0
2013-10-31 16:19:29,604 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_824648574 given task: attempt_20131031160444934_0033_m_000004_0
2013-10-31 16:19:29,619 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-426699948 given task: attempt_20131031160444934_0033_m_000003_0
2013-10-31 16:19:29,661 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49638, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 128932
2013-10-31 16:19:29,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split	dst=null	perm=null
2013-10-31 16:19:29,971 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36607, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_777667023145340875_1382, duration: 161946
2013-10-31 16:19:30,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:19:30,011 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49641, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 258419
2013-10-31 16:19:30,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split	dst=null	perm=null
2013-10-31 16:19:30,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split	dst=null	perm=null
2013-10-31 16:19:30,120 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36542, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777667023145340875_1382, duration: 170149
2013-10-31 16:19:30,122 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56648, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777667023145340875_1382, duration: 166468
2013-10-31 16:19:30,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:19:30,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:19:30,160 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36613, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 131601
2013-10-31 16:19:30,162 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49647, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 98100
2013-10-31 16:19:31,727 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:19:31,730 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000001_0 is done.
2013-10-31 16:19:31,731 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000001_0  was 23
2013-10-31 16:19:31,731 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:19:32,274 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:19:32,277 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000000_0 is done.
2013-10-31 16:19:32,277 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000000_0  was 23
2013-10-31 16:19:32,278 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:32,900 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:19:32,903 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000002_0 is done.
2013-10-31 16:19:32,903 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000002_0  was 23
2013-10-31 16:19:32,903 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:19:32,924 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0033_m_000006_0
2013-10-31 16:19:32,924 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0033_m_000006_0
2013-10-31 16:19:32,924 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0033_m_000006_0 not found in cache
2013-10-31 16:19:33,049 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:19:33,051 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:19:33,052 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000004_0 is done.
2013-10-31 16:19:33,053 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000004_0  was 23
2013-10-31 16:19:33,053 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:33,054 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000003_0 is done.
2013-10-31 16:19:33,054 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000003_0  was 23
2013-10-31 16:19:33,054 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:33,930 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000000_0' has completed task_20131031160444934_0033_m_000000 successfully.
2013-10-31 16:19:33,985 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000001_0' has completed task_20131031160444934_0033_m_000001 successfully.
2013-10-31 16:19:33,987 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0033_r_000000_0' to tip task_20131031160444934_0033_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:33,988 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000002_0' has completed task_20131031160444934_0033_m_000002 successfully.
2013-10-31 16:19:33,989 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:19:33,990 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_r_000000_0 which needs 1 slots
2013-10-31 16:19:33,990 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_r_000000_0 which needs 1 slots
2013-10-31 16:19:33,990 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000003_0' has completed task_20131031160444934_0033_m_000003 successfully.
2013-10-31 16:19:33,997 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000004_0' has completed task_20131031160444934_0033_m_000004 successfully.
2013-10-31 16:19:34,028 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_r_-710893147
2013-10-31 16:19:34,029 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_r_-710893147 spawned.
2013-10-31 16:19:34,032 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_r_000000_0/taskjvm.sh
2013-10-31 16:19:34,945 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_r_-710893147 given task: attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:39,847 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:19:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,875 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,880 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,886 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,891 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,891 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:19:40,621 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:44479, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000000_0, duration: 6027347
2013-10-31 16:19:40,636 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:44479, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000001_0, duration: 9540176
2013-10-31 16:19:40,651 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60278, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000002_0, duration: 10219769
2013-10-31 16:19:40,666 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60278, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000003_0, duration: 11205550
2013-10-31 16:19:40,682 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:48347, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000004_0, duration: 11638366
2013-10-31 16:19:41,437 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:19:41,482 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:19:41,540 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:19:41,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:41,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:41,791 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000. blk_6547866045732676229_1388
2013-10-31 16:19:41,833 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6547866045732676229_1388 src: /127.0.0.1:56660 dest: /127.0.0.1:41648
2013-10-31 16:19:41,834 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6547866045732676229_1388 src: /127.0.0.1:36556 dest: /127.0.0.1:50942
2013-10-31 16:19:41,835 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6547866045732676229_1388 src: /127.0.0.1:36626 dest: /127.0.0.1:38271
2013-10-31 16:19:41,838 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36626, dest: /127.0.0.1:38271, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0033_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6547866045732676229_1388, duration: 1447582
2013-10-31 16:19:41,839 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6547866045732676229_1388 terminating
2013-10-31 16:19:41,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36556, dest: /127.0.0.1:50942, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0033_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6547866045732676229_1388, duration: 2591590
2013-10-31 16:19:41,839 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6547866045732676229_1388 terminating
2013-10-31 16:19:41,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56660, dest: /127.0.0.1:41648, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0033_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6547866045732676229_1388, duration: 3038491
2013-10-31 16:19:41,839 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6547866045732676229_1388 terminating
2013-10-31 16:19:41,841 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6547866045732676229_1388 size 180
2013-10-31 16:19:41,842 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:41,842 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:41,842 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6547866045732676229_1388 size 180
2013-10-31 16:19:41,843 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6547866045732676229_1388 size 180
2013-10-31 16:19:41,877 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0033_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:19:41,878 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:19:42,998 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031160444934_0033_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:55789
2013-10-31 16:19:42,999 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:43,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0	dst=null	perm=null
2013-10-31 16:19:43,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:43,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:43,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0	dst=null	perm=null
2013-10-31 16:19:44,486 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 1.0% reduce > reduce
2013-10-31 16:19:44,488 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 1.0% reduce > reduce
2013-10-31 16:19:44,489 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_r_000000_0 is done.
2013-10-31 16:19:44,489 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_r_000000_0  was -1
2013-10-31 16:19:44,490 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:46,003 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_r_000000_0' has completed task_20131031160444934_0033_r_000000 successfully.
2013-10-31 16:19:46,018 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0033_m_000005_0' to tip task_20131031160444934_0033_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:46,021 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:19:46,021 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000005_0 which needs 1 slots
2013-10-31 16:19:46,021 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000005_0 which needs 1 slots
2013-10-31 16:19:46,054 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0033/attempt_20131031160444934_0033_m_000005_0. Attempting to reuse: jvm_20131031160444934_0033_m_-1126263002
2013-10-31 16:19:47,280 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-1126263002 given task: attempt_20131031160444934_0033_m_000005_0
2013-10-31 16:19:47,389 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000005_0 0.0% 
2013-10-31 16:19:47,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary	dst=null	perm=null
2013-10-31 16:19:47,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:47,411 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_SUCCESS from client DFSClient_attempt_20131031160444934_0033_m_000005_0
2013-10-31 16:19:47,411 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0033_m_000005_0
2013-10-31 16:19:47,415 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-453853160008994316 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:47,416 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-453853160008994316 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:47,416 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-453853160008994316 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:47,416 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-453853160008994316 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:47,416 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777667023145340875 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:47,416 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777667023145340875 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:47,416 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777667023145340875 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:47,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777667023145340875 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:47,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1600864550067754613 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:47,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1600864550067754613 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:47,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1600864550067754613 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:47,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7933150028582980354 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:47,417 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7933150028582980354 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:47,418 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7933150028582980354 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:47,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033	dst=null	perm=null
2013-10-31 16:19:48,356 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_777667023145340875_1382 blk_-7933150028582980354_1384 blk_-453853160008994316_1381 blk_1600864550067754613_1383
2013-10-31 16:19:48,357 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_777667023145340875_1382 blk_-7933150028582980354_1384 blk_-453853160008994316_1381 blk_1600864550067754613_1383
2013-10-31 16:19:50,364 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000005_0 0.0% cleanup
2013-10-31 16:19:50,365 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000005_0 is done.
2013-10-31 16:19:50,366 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000005_0  was -1
2013-10-31 16:19:50,366 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:50,925 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7933150028582980354_1384 file build/test/data/dfs/data/data1/current/blk_-7933150028582980354 for deletion
2013-10-31 16:19:50,925 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-453853160008994316_1381 file build/test/data/dfs/data/data1/current/blk_-453853160008994316 for deletion
2013-10-31 16:19:50,926 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7933150028582980354_1384 at file build/test/data/dfs/data/data1/current/blk_-7933150028582980354
2013-10-31 16:19:50,926 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777667023145340875_1382 file build/test/data/dfs/data/data1/current/blk_777667023145340875 for deletion
2013-10-31 16:19:50,926 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-453853160008994316_1381 at file build/test/data/dfs/data/data1/current/blk_-453853160008994316
2013-10-31 16:19:50,926 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1600864550067754613_1383 file build/test/data/dfs/data/data2/current/blk_1600864550067754613 for deletion
2013-10-31 16:19:50,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777667023145340875_1382 at file build/test/data/dfs/data/data1/current/blk_777667023145340875
2013-10-31 16:19:50,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1600864550067754613_1383 at file build/test/data/dfs/data/data2/current/blk_1600864550067754613
2013-10-31 16:19:51,021 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:51,022 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:51,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7933150028582980354_1384 file build/test/data/dfs/data/data8/current/blk_-7933150028582980354 for deletion
2013-10-31 16:19:51,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-453853160008994316_1381 file build/test/data/dfs/data/data7/current/blk_-453853160008994316 for deletion
2013-10-31 16:19:51,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7933150028582980354_1384 at file build/test/data/dfs/data/data8/current/blk_-7933150028582980354
2013-10-31 16:19:51,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777667023145340875_1382 file build/test/data/dfs/data/data8/current/blk_777667023145340875 for deletion
2013-10-31 16:19:51,136 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-453853160008994316_1381 at file build/test/data/dfs/data/data7/current/blk_-453853160008994316
2013-10-31 16:19:51,136 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777667023145340875_1382 at file build/test/data/dfs/data/data8/current/blk_777667023145340875
2013-10-31 16:19:51,136 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1600864550067754613_1383 file build/test/data/dfs/data/data7/current/blk_1600864550067754613 for deletion
2013-10-31 16:19:51,136 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1600864550067754613_1383 at file build/test/data/dfs/data/data7/current/blk_1600864550067754613
2013-10-31 16:19:51,357 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_777667023145340875_1382 blk_-7933150028582980354_1384 blk_-453853160008994316_1381 blk_1600864550067754613_1383
2013-10-31 16:19:51,358 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_777667023145340875_1382 blk_-453853160008994316_1381
2013-10-31 16:19:51,525 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-453853160008994316_1381 file build/test/data/dfs/data/data4/current/blk_-453853160008994316 for deletion
2013-10-31 16:19:51,525 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777667023145340875_1382 file build/test/data/dfs/data/data3/current/blk_777667023145340875 for deletion
2013-10-31 16:19:51,526 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-453853160008994316_1381 at file build/test/data/dfs/data/data4/current/blk_-453853160008994316
2013-10-31 16:19:51,526 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777667023145340875_1382 at file build/test/data/dfs/data/data3/current/blk_777667023145340875
2013-10-31 16:19:52,030 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000005_0' has completed task_20131031160444934_0033_m_000005 successfully.
2013-10-31 16:19:52,031 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0033 has completed successfully.
2013-10-31 16:19:52,031 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0033,submitTime=1383236356670,launchTime=1383236356784,firstMapTaskLaunchTime=1383236367918,firstReduceTaskLaunchTime=1383236373986,firstJobSetupTaskLaunchTime=1383236358897,firstJobCleanupTaskLaunchTime=1383236386018,finishTime=1383236392031,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1686E7C7AC8C482C92D85BC9B258DF0C/FD555B8F6C784F1D9145DCB3DE82E908] lhs*rhs/(2/2)
2013-10-31 16:19:52,035 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D. blk_-4238039309339233228_1389
2013-10-31 16:19:52,040 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4238039309339233228_1389 src: /127.0.0.1:56665 dest: /127.0.0.1:41648
2013-10-31 16:19:52,042 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4238039309339233228_1389 src: /127.0.0.1:49663 dest: /127.0.0.1:47311
2013-10-31 16:19:52,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4238039309339233228_1389 src: /127.0.0.1:36631 dest: /127.0.0.1:38271
2013-10-31 16:19:52,053 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36631, dest: /127.0.0.1:38271, bytes: 31961, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4238039309339233228_1389, duration: 2241053
2013-10-31 16:19:52,054 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4238039309339233228_1389 terminating
2013-10-31 16:19:52,054 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4238039309339233228_1389 size 31961
2013-10-31 16:19:52,054 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49663, dest: /127.0.0.1:47311, bytes: 31961, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4238039309339233228_1389, duration: 3998942
2013-10-31 16:19:52,055 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4238039309339233228_1389 terminating
2013-10-31 16:19:52,055 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56665, dest: /127.0.0.1:41648, bytes: 31961, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4238039309339233228_1389, duration: 5079672
2013-10-31 16:19:52,056 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4238039309339233228_1389 terminating
2013-10-31 16:19:52,059 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4238039309339233228_1389 size 31961
2013-10-31 16:19:52,059 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D from client DFSClient_1812894713
2013-10-31 16:19:52,060 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D is closed by DFSClient_1812894713
2013-10-31 16:19:52,060 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4238039309339233228_1389 size 31961
2013-10-31 16:19:52,069 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:19:52,070 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000000_0'
2013-10-31 16:19:52,070 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000001_0'
2013-10-31 16:19:52,071 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000005_0'
2013-10-31 16:19:52,072 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000006_0'
2013-10-31 16:19:52,072 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_r_000000_0'
2013-10-31 16:19:52,073 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000004_0'
2013-10-31 16:19:52,075 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0033_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:19:52,077 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] starting step: (1/2) ...orm/samepipearoundgroupby
2013-10-31 16:19:52,079 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:19:52,080 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3881077061080299198 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:52,081 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3881077061080299198 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:52,081 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3881077061080299198 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:52,083 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:19:52,084 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:19:52,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033	dst=null	perm=null
2013-10-31 16:19:52,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:52,127 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0033
2013-10-31 16:19:52,127 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0033 being deleted.
2013-10-31 16:19:52,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:19:52,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:52,141 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7933150028582980354_1384 file build/test/data/dfs/data/data5/current/blk_-7933150028582980354 for deletion
2013-10-31 16:19:52,142 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-453853160008994316_1381 file build/test/data/dfs/data/data6/current/blk_-453853160008994316 for deletion
2013-10-31 16:19:52,142 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7933150028582980354_1384 at file build/test/data/dfs/data/data5/current/blk_-7933150028582980354
2013-10-31 16:19:52,142 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777667023145340875_1382 file build/test/data/dfs/data/data5/current/blk_777667023145340875 for deletion
2013-10-31 16:19:52,142 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-453853160008994316_1381 at file build/test/data/dfs/data/data6/current/blk_-453853160008994316
2013-10-31 16:19:52,142 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777667023145340875_1382 at file build/test/data/dfs/data/data5/current/blk_777667023145340875
2013-10-31 16:19:52,143 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1600864550067754613_1383 file build/test/data/dfs/data/data6/current/blk_1600864550067754613 for deletion
2013-10-31 16:19:52,143 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar. blk_-1839156841999928741_1390
2013-10-31 16:19:52,143 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1600864550067754613_1383 at file build/test/data/dfs/data/data6/current/blk_1600864550067754613
2013-10-31 16:19:52,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1839156841999928741_1390 src: /127.0.0.1:36633 dest: /127.0.0.1:38271
2013-10-31 16:19:52,146 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1839156841999928741_1390 src: /127.0.0.1:56670 dest: /127.0.0.1:41648
2013-10-31 16:19:52,147 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1839156841999928741_1390 src: /127.0.0.1:49668 dest: /127.0.0.1:47311
2013-10-31 16:19:52,158 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49668, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1839156841999928741_1390, duration: 6994824
2013-10-31 16:19:52,159 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1839156841999928741_1390 terminating
2013-10-31 16:19:52,159 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56670, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1839156841999928741_1390, duration: 8069094
2013-10-31 16:19:52,160 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1839156841999928741_1390 terminating
2013-10-31 16:19:52,160 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36633, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1839156841999928741_1390, duration: 9117361
2013-10-31 16:19:52,161 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1839156841999928741_1390 terminating
2013-10-31 16:19:52,163 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1839156841999928741_1390 size 238055
2013-10-31 16:19:52,164 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar from client DFSClient_1457307213
2013-10-31 16:19:52,164 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar is closed by DFSClient_1457307213
2013-10-31 16:19:52,165 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1839156841999928741_1390 size 238055
2013-10-31 16:19:52,165 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1839156841999928741_1390 size 238055
2013-10-31 16:19:52,171 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar. New replication is 10
2013-10-31 16:19:52,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar	dst=null	perm=null
2013-10-31 16:19:52,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:52,184 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:19:52,189 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:19:52,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:19:52,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:52,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:52,205 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split. New replication is 10
2013-10-31 16:19:52,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split	dst=null	perm=null
2013-10-31 16:19:52,215 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split. blk_-2322401317774502462_1391
2013-10-31 16:19:52,216 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2322401317774502462_1391 src: /127.0.0.1:36636 dest: /127.0.0.1:38271
2013-10-31 16:19:52,218 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2322401317774502462_1391 src: /127.0.0.1:36568 dest: /127.0.0.1:50942
2013-10-31 16:19:52,220 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2322401317774502462_1391 src: /127.0.0.1:56674 dest: /127.0.0.1:41648
2013-10-31 16:19:52,221 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2322401317774502462_1391 src: /127.0.0.1:49672 dest: /127.0.0.1:47311
2013-10-31 16:19:52,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49672, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2322401317774502462_1391, duration: 115024
2013-10-31 16:19:52,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2322401317774502462_1391 terminating
2013-10-31 16:19:52,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56674, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2322401317774502462_1391, duration: 947352
2013-10-31 16:19:52,226 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2322401317774502462_1391 terminating
2013-10-31 16:19:52,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36568, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2322401317774502462_1391, duration: 1824079
2013-10-31 16:19:52,227 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2322401317774502462_1391 terminating
2013-10-31 16:19:52,227 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2322401317774502462_1391 size 1732
2013-10-31 16:19:52,227 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36636, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2322401317774502462_1391, duration: 2765334
2013-10-31 16:19:52,228 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2322401317774502462_1391 terminating
2013-10-31 16:19:52,232 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2322401317774502462_1391 size 1732
2013-10-31 16:19:52,233 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split from client DFSClient_1457307213
2013-10-31 16:19:52,233 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split is closed by DFSClient_1457307213
2013-10-31 16:19:52,234 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2322401317774502462_1391 size 1732
2013-10-31 16:19:52,234 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2322401317774502462_1391 size 1732
2013-10-31 16:19:53,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,431 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo. blk_-5860927746139113368_1392
2013-10-31 16:19:53,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5860927746139113368_1392 src: /127.0.0.1:36640 dest: /127.0.0.1:38271
2013-10-31 16:19:53,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5860927746139113368_1392 src: /127.0.0.1:49674 dest: /127.0.0.1:47311
2013-10-31 16:19:53,436 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5860927746139113368_1392 src: /127.0.0.1:36573 dest: /127.0.0.1:50942
2013-10-31 16:19:53,439 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36573, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5860927746139113368_1392, duration: 192022
2013-10-31 16:19:53,440 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5860927746139113368_1392 terminating
2013-10-31 16:19:53,440 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49674, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5860927746139113368_1392, duration: 1018601
2013-10-31 16:19:53,441 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5860927746139113368_1392 terminating
2013-10-31 16:19:53,441 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5860927746139113368_1392 size 183
2013-10-31 16:19:53,441 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36640, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5860927746139113368_1392, duration: 1928770
2013-10-31 16:19:53,442 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5860927746139113368_1392 terminating
2013-10-31 16:19:53,444 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5860927746139113368_1392 size 183
2013-10-31 16:19:53,444 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:19:53,444 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:19:53,445 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5860927746139113368_1392 size 183
2013-10-31 16:19:53,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,472 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml. blk_-8691688367478710441_1393
2013-10-31 16:19:53,473 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8691688367478710441_1393 src: /127.0.0.1:36643 dest: /127.0.0.1:38271
2013-10-31 16:19:53,475 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8691688367478710441_1393 src: /127.0.0.1:56680 dest: /127.0.0.1:41648
2013-10-31 16:19:53,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8691688367478710441_1393 src: /127.0.0.1:49678 dest: /127.0.0.1:47311
2013-10-31 16:19:53,480 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49678, dest: /127.0.0.1:47311, bytes: 28750, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8691688367478710441_1393, duration: 238313
2013-10-31 16:19:53,480 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8691688367478710441_1393 terminating
2013-10-31 16:19:53,481 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56680, dest: /127.0.0.1:41648, bytes: 28750, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8691688367478710441_1393, duration: 969974
2013-10-31 16:19:53,481 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8691688367478710441_1393 terminating
2013-10-31 16:19:53,481 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8691688367478710441_1393 size 28750
2013-10-31 16:19:53,481 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36643, dest: /127.0.0.1:38271, bytes: 28750, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 1831610
2013-10-31 16:19:53,482 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8691688367478710441_1393 terminating
2013-10-31 16:19:53,482 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8691688367478710441_1393 size 28750
2013-10-31 16:19:53,484 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml from client DFSClient_1457307213
2013-10-31 16:19:53,484 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml is closed by DFSClient_1457307213
2013-10-31 16:19:53,486 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8691688367478710441_1393 size 28750
2013-10-31 16:19:53,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml	dst=null	perm=null
2013-10-31 16:19:53,503 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36647, bytes: 28978, op: HDFS_READ, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 387786
2013-10-31 16:19:53,522 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0034: nMaps=5 nReduces=0 max=-1
2013-10-31 16:19:53,523 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0034 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:19:53,523 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0034
2013-10-31 16:19:53,523 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0034	RESULT=SUCCESS
2013-10-31 16:19:53,523 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0034
2013-10-31 16:19:53,524 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] submitted hadoop job: job_20131031160444934_0034
2013-10-31 16:19:53,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,555 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_conf.xml. blk_-8704972263531238624_1395
2013-10-31 16:19:53,557 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8704972263531238624_1395 src: /127.0.0.1:56684 dest: /127.0.0.1:41648
2013-10-31 16:19:53,558 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8704972263531238624_1395 src: /127.0.0.1:49682 dest: /127.0.0.1:47311
2013-10-31 16:19:53,560 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8704972263531238624_1395 src: /127.0.0.1:36650 dest: /127.0.0.1:38271
2013-10-31 16:19:53,564 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36650, dest: /127.0.0.1:38271, bytes: 28815, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8704972263531238624_1395, duration: 621603
2013-10-31 16:19:53,564 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8704972263531238624_1395 terminating
2013-10-31 16:19:53,565 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49682, dest: /127.0.0.1:47311, bytes: 28815, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8704972263531238624_1395, duration: 1785158
2013-10-31 16:19:53,565 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8704972263531238624_1395 terminating
2013-10-31 16:19:53,565 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8704972263531238624_1395 size 28815
2013-10-31 16:19:53,565 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56684, dest: /127.0.0.1:41648, bytes: 28815, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8704972263531238624_1395, duration: 2414255
2013-10-31 16:19:53,566 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8704972263531238624_1395 terminating
2013-10-31 16:19:53,566 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8704972263531238624_1395 size 28815
2013-10-31 16:19:53,569 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_conf.xml from client DFSClient_-1483996041
2013-10-31 16:19:53,570 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_conf.xml is closed by DFSClient_-1483996041
2013-10-31 16:19:53,570 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8704972263531238624_1395 size 28815
2013-10-31 16:19:54,358 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-1839156841999928741_1390 to datanode(s) 127.0.0.1:50942
2013-10-31 16:19:54,359 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_3881077061080299198_1387
2013-10-31 16:19:54,359 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_3881077061080299198_1387
2013-10-31 16:19:54,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:54,395 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken. blk_4679661962309866501_1396
2013-10-31 16:19:54,397 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679661962309866501_1396 src: /127.0.0.1:36651 dest: /127.0.0.1:38271
2013-10-31 16:19:54,398 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679661962309866501_1396 src: /127.0.0.1:49685 dest: /127.0.0.1:47311
2013-10-31 16:19:54,400 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679661962309866501_1396 src: /127.0.0.1:36584 dest: /127.0.0.1:50942
2013-10-31 16:19:54,403 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36584, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4679661962309866501_1396, duration: 88119
2013-10-31 16:19:54,403 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4679661962309866501_1396 terminating
2013-10-31 16:19:54,404 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49685, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4679661962309866501_1396, duration: 1005827
2013-10-31 16:19:54,404 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4679661962309866501_1396 size 116
2013-10-31 16:19:54,404 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4679661962309866501_1396 terminating
2013-10-31 16:19:54,405 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36651, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4679661962309866501_1396, duration: 2110548
2013-10-31 16:19:54,405 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4679661962309866501_1396 size 116
2013-10-31 16:19:54,405 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4679661962309866501_1396 terminating
2013-10-31 16:19:54,408 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4679661962309866501_1396 size 116
2013-10-31 16:19:54,408 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken from client DFSClient_1457307213
2013-10-31 16:19:54,409 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken is closed by DFSClient_1457307213
2013-10-31 16:19:54,416 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken
2013-10-31 16:19:54,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:19:54,420 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49687, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5860927746139113368_1392, duration: 271478
2013-10-31 16:19:54,421 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0034 = 19. Number of splits = 5
2013-10-31 16:19:54,422 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,422 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,422 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,422 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,425 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,425 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,425 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0034 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:19:54,426 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0034 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:19:55,032 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0034_m_000006_0' to tip task_20131031160444934_0034_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:19:55,037 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000002_0'
2013-10-31 16:19:55,037 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000003_0'
2013-10-31 16:19:55,039 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:19:55,039 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000006_0 which needs 1 slots
2013-10-31 16:19:55,039 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000006_0 which needs 1 slots
2013-10-31 16:19:55,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken	dst=null	perm=null
2013-10-31 16:19:55,044 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49689, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4679661962309866501_1396, duration: 289454
2013-10-31 16:19:55,049 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml	dst=null	perm=null
2013-10-31 16:19:55,053 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36658, bytes: 28978, op: HDFS_READ, cliID: DFSClient_-873370843, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 391088
2013-10-31 16:19:55,080 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:19:55,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar	dst=null	perm=null
2013-10-31 16:19:55,113 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49692, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-873370843, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1839156841999928741_1390, duration: 1446808
2013-10-31 16:19:55,205 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0033_m_-357406308
2013-10-31 16:19:55,213 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30981 with signal TERM. Exit code 0
2013-10-31 16:19:55,213 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_408401697
2013-10-31 16:19:55,214 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_408401697 spawned.
2013-10-31 16:19:55,215 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000006_0/taskjvm.sh
2013-10-31 16:19:55,844 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:55,844 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:55,844 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:55,844 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_-357406308 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:56,550 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_408401697 given task: attempt_20131031160444934_0034_m_000006_0
2013-10-31 16:19:56,927 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-1839156841999928741_1390 to 127.0.0.1:50942 
2013-10-31 16:19:56,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3881077061080299198_1387 file build/test/data/dfs/data/data2/current/blk_3881077061080299198 for deletion
2013-10-31 16:19:56,928 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3881077061080299198_1387 at file build/test/data/dfs/data/data2/current/blk_3881077061080299198
2013-10-31 16:19:56,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1839156841999928741_1390 src: /127.0.0.1:36592 dest: /127.0.0.1:50942
2013-10-31 16:19:56,928 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-1839156841999928741_1390 to /127.0.0.1:50942
2013-10-31 16:19:56,930 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1839156841999928741_1390 src: /127.0.0.1:36592 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:19:56,930 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1839156841999928741_1390 size 238055
2013-10-31 16:19:57,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:57,073 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0033
2013-10-31 16:19:57,073 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0033_m_000005_0 not found in cache
2013-10-31 16:19:57,074 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0033 for user-log deletion with retainTimeStamp:1383322797074
2013-10-31 16:19:57,085 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0033
2013-10-31 16:19:57,086 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0033 for user-log deletion with retainTimeStamp:1383322797085
2013-10-31 16:19:57,137 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3881077061080299198_1387 file build/test/data/dfs/data/data8/current/blk_3881077061080299198 for deletion
2013-10-31 16:19:57,137 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3881077061080299198_1387 at file build/test/data/dfs/data/data8/current/blk_3881077061080299198
2013-10-31 16:19:57,360 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_3881077061080299198_1387
2013-10-31 16:19:57,628 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_m_824648574 since job job_20131031160444934_0033 is dead
2013-10-31 16:19:57,639 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31024 with signal TERM. Exit code 0
2013-10-31 16:19:57,861 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:57,861 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:57,861 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:57,861 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_824648574 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:58,144 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3881077061080299198_1387 file build/test/data/dfs/data/data5/current/blk_3881077061080299198 for deletion
2013-10-31 16:19:58,144 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3881077061080299198_1387 at file build/test/data/dfs/data/data5/current/blk_3881077061080299198
2013-10-31 16:19:58,363 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_m_-1857432135 since job job_20131031160444934_0033 is dead
2013-10-31 16:19:58,374 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30920 with signal TERM. Exit code 0
2013-10-31 16:19:58,404 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_m_-1126263002 since job job_20131031160444934_0033 is dead
2013-10-31 16:19:58,412 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30830 with signal TERM. Exit code 0
2013-10-31 16:19:58,529 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_r_-710893147 since job job_20131031160444934_0033 is dead
2013-10-31 16:19:58,533 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31197 with signal TERM. Exit code 0
2013-10-31 16:19:58,584 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:58,584 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:58,584 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:58,584 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_-1126263002 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:19:58,603 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:58,604 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:58,604 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:58,604 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_-1857432135 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:58,684 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:58,684 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:58,684 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:19:58,684 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_r_-710893147 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:59,991 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000006_0 0.0% setup
2013-10-31 16:19:59,994 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000006_0 is done.
2013-10-31 16:19:59,995 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000006_0  was -1
2013-10-31 16:19:59,995 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:00,039 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0033
2013-10-31 16:20:00,040 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0033 for user-log deletion with retainTimeStamp:1383322800040
2013-10-31 16:20:00,631 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_m_-426699948 since job job_20131031160444934_0033 is dead
2013-10-31 16:20:00,641 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31023 with signal TERM. Exit code 0
2013-10-31 16:20:01,026 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:01,027 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:01,027 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:01,027 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_-426699948 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:01,044 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000006_0' has completed task_20131031160444934_0034_m_000006 successfully.
2013-10-31 16:20:01,047 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000000_0' to tip task_20131031160444934_0034_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:01,048 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000000
2013-10-31 16:20:01,049 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000001_0' to tip task_20131031160444934_0034_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:01,049 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000001
2013-10-31 16:20:01,050 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:20:01,051 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:20:01,051 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000000_0 which needs 1 slots
2013-10-31 16:20:01,051 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000000_0 which needs 1 slots
2013-10-31 16:20:01,051 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000001_0 which needs 1 slots
2013-10-31 16:20:01,051 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0034_m_000001_0 which needs 1 slots
2013-10-31 16:20:01,070 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_29013589
2013-10-31 16:20:01,071 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_29013589 spawned.
2013-10-31 16:20:01,072 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000000_0/taskjvm.sh
2013-10-31 16:20:01,082 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000002_0' to tip task_20131031160444934_0034_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:01,082 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000002
2013-10-31 16:20:01,082 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000003_0' to tip task_20131031160444934_0034_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:01,091 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0034/attempt_20131031160444934_0034_m_000001_0. Attempting to reuse: jvm_20131031160444934_0034_m_408401697
2013-10-31 16:20:01,093 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000003
2013-10-31 16:20:01,094 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000004_0' to tip task_20131031160444934_0034_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:01,095 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000004
2013-10-31 16:20:01,097 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:20:01,097 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:20:01,098 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:20:01,099 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000002_0 which needs 1 slots
2013-10-31 16:20:01,099 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000004_0 which needs 1 slots
2013-10-31 16:20:01,099 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000002_0 which needs 1 slots
2013-10-31 16:20:01,099 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000004_0 which needs 1 slots
2013-10-31 16:20:01,099 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000003_0 which needs 1 slots
2013-10-31 16:20:01,100 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0034_m_000003_0 which needs 1 slots
2013-10-31 16:20:01,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken	dst=null	perm=null
2013-10-31 16:20:01,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken	dst=null	perm=null
2013-10-31 16:20:01,105 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49697, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4679661962309866501_1396, duration: 305505
2013-10-31 16:20:01,105 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49698, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4679661962309866501_1396, duration: 284010
2013-10-31 16:20:01,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml	dst=null	perm=null
2013-10-31 16:20:01,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml	dst=null	perm=null
2013-10-31 16:20:01,115 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36668, bytes: 28978, op: HDFS_READ, cliID: DFSClient_1881494894, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 376068
2013-10-31 16:20:01,116 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36669, bytes: 28978, op: HDFS_READ, cliID: DFSClient_2055900766, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 419730
2013-10-31 16:20:01,149 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:01,150 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:01,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar	dst=null	perm=null
2013-10-31 16:20:01,175 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49703, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2055900766, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1839156841999928741_1390, duration: 707705
2013-10-31 16:20:01,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar	dst=null	perm=null
2013-10-31 16:20:01,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56707, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1881494894, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1839156841999928741_1390, duration: 632935
2013-10-31 16:20:01,244 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_33509852
2013-10-31 16:20:01,245 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_33509852 spawned.
2013-10-31 16:20:01,245 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_-112746602
2013-10-31 16:20:01,245 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_-2125602537
2013-10-31 16:20:01,246 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_-112746602 spawned.
2013-10-31 16:20:01,246 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_-2125602537 spawned.
2013-10-31 16:20:01,247 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000002_0/taskjvm.sh
2013-10-31 16:20:01,248 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000003_0/taskjvm.sh
2013-10-31 16:20:01,248 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000004_0/taskjvm.sh
2013-10-31 16:20:01,552 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_408401697 given task: attempt_20131031160444934_0034_m_000001_0
2013-10-31 16:20:01,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split	dst=null	perm=null
2013-10-31 16:20:01,697 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36673, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2322401317774502462_1391, duration: 161362
2013-10-31 16:20:01,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:01,757 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49707, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 131231
2013-10-31 16:20:01,765 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2110 Total time for transactions(ms): 46Number of transactions batched in Syncs: 227 Number of syncs: 1512 SyncTimes(ms): 71472 15023 
2013-10-31 16:20:01,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:01,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:01,999 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_29013589 given task: attempt_20131031160444934_0034_m_000000_0
2013-10-31 16:20:02,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0	dst=null	perm=null
2013-10-31 16:20:02,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:02,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:02,355 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36676, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6547866045732676229_1388, duration: 145370
2013-10-31 16:20:02,377 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001. blk_-381001259991911914_1397
2013-10-31 16:20:02,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-381001259991911914_1397 src: /127.0.0.1:49710 dest: /127.0.0.1:47311
2013-10-31 16:20:02,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-381001259991911914_1397 src: /127.0.0.1:36609 dest: /127.0.0.1:50942
2013-10-31 16:20:02,396 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-381001259991911914_1397 src: /127.0.0.1:36679 dest: /127.0.0.1:38271
2013-10-31 16:20:02,398 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36679, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-381001259991911914_1397, duration: 1294583
2013-10-31 16:20:02,399 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-381001259991911914_1397 terminating
2013-10-31 16:20:02,399 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36609, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-381001259991911914_1397, duration: 1791628
2013-10-31 16:20:02,399 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-381001259991911914_1397 terminating
2013-10-31 16:20:02,399 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-381001259991911914_1397 size 8
2013-10-31 16:20:02,399 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49710, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-381001259991911914_1397, duration: 2224525
2013-10-31 16:20:02,400 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-381001259991911914_1397 terminating
2013-10-31 16:20:02,401 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-381001259991911914_1397 size 8
2013-10-31 16:20:02,401 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0034_m_000001_0
2013-10-31 16:20:02,402 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0034_m_000001_0
2013-10-31 16:20:02,403 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-381001259991911914_1397 size 8
2013-10-31 16:20:02,753 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_33509852 given task: attempt_20131031160444934_0034_m_000002_0
2013-10-31 16:20:02,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split	dst=null	perm=null
2013-10-31 16:20:02,804 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49716, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2322401317774502462_1391, duration: 168009
2013-10-31 16:20:02,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:02,967 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_-2125602537 given task: attempt_20131031160444934_0034_m_000004_0
2013-10-31 16:20:02,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:02,978 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_-112746602 given task: attempt_20131031160444934_0034_m_000003_0
2013-10-31 16:20:02,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:03,004 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:03,005 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000001_0 0.0% 
2013-10-31 16:20:03,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0	dst=null	perm=null
2013-10-31 16:20:03,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:03,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:03,212 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36686, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6547866045732676229_1388, duration: 131151
2013-10-31 16:20:03,231 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36687, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 111261
2013-10-31 16:20:03,238 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000. blk_-1599467073490731312_1398
2013-10-31 16:20:03,261 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1599467073490731312_1398 src: /127.0.0.1:36619 dest: /127.0.0.1:50942
2013-10-31 16:20:03,262 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1599467073490731312_1398 src: /127.0.0.1:56725 dest: /127.0.0.1:41648
2013-10-31 16:20:03,263 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1599467073490731312_1398 src: /127.0.0.1:49723 dest: /127.0.0.1:47311
2013-10-31 16:20:03,265 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49723, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1599467073490731312_1398, duration: 1039951
2013-10-31 16:20:03,265 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1599467073490731312_1398 terminating
2013-10-31 16:20:03,265 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56725, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1599467073490731312_1398, duration: 1417688
2013-10-31 16:20:03,266 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1599467073490731312_1398 terminating
2013-10-31 16:20:03,266 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36619, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1599467073490731312_1398, duration: 1803669
2013-10-31 16:20:03,266 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1599467073490731312_1398 terminating
2013-10-31 16:20:03,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split	dst=null	perm=null
2013-10-31 16:20:03,267 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1599467073490731312_1398 size 8
2013-10-31 16:20:03,267 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1599467073490731312_1398 size 8
2013-10-31 16:20:03,269 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1599467073490731312_1398 size 8
2013-10-31 16:20:03,273 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49724, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2322401317774502462_1391, duration: 150720
2013-10-31 16:20:03,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:03,315 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49725, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 260553
2013-10-31 16:20:03,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:03,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:03,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split	dst=null	perm=null
2013-10-31 16:20:03,467 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49728, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2322401317774502462_1391, duration: 167758
2013-10-31 16:20:03,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split	dst=null	perm=null
2013-10-31 16:20:03,493 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36627, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2322401317774502462_1391, duration: 145752
2013-10-31 16:20:03,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:03,507 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36628, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 107805
2013-10-31 16:20:03,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:03,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:03,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:03,534 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49731, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 120610
2013-10-31 16:20:03,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0	dst=null	perm=null
2013-10-31 16:20:03,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:03,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:03,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:03,559 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56735, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6547866045732676229_1388, duration: 124139
2013-10-31 16:20:03,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:03,583 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002. blk_5383765050450234615_1401
2013-10-31 16:20:03,606 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5383765050450234615_1401 src: /127.0.0.1:36631 dest: /127.0.0.1:50942
2013-10-31 16:20:03,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5383765050450234615_1401 src: /127.0.0.1:56737 dest: /127.0.0.1:41648
2013-10-31 16:20:03,608 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5383765050450234615_1401 src: /127.0.0.1:49735 dest: /127.0.0.1:47311
2013-10-31 16:20:03,610 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49735, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5383765050450234615_1401, duration: 1238241
2013-10-31 16:20:03,610 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5383765050450234615_1401 terminating
2013-10-31 16:20:03,611 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56737, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5383765050450234615_1401, duration: 1498192
2013-10-31 16:20:03,611 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5383765050450234615_1401 terminating
2013-10-31 16:20:03,611 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36631, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5383765050450234615_1401, duration: 1870458
2013-10-31 16:20:03,611 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5383765050450234615_1401 terminating
2013-10-31 16:20:03,611 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5383765050450234615_1401 size 8
2013-10-31 16:20:03,612 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0034_m_000002_0
2013-10-31 16:20:03,612 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0034_m_000002_0
2013-10-31 16:20:03,613 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5383765050450234615_1401 size 8
2013-10-31 16:20:03,613 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5383765050450234615_1401 size 8
2013-10-31 16:20:03,660 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:03,660 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000002_0 0.0% 
2013-10-31 16:20:03,668 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0034_m_000000_0
2013-10-31 16:20:03,668 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0034_m_000000_0
2013-10-31 16:20:03,720 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:03,720 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000000_0 0.0% 
2013-10-31 16:20:03,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0	dst=null	perm=null
2013-10-31 16:20:03,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:03,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:03,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0	dst=null	perm=null
2013-10-31 16:20:03,769 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36634, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6547866045732676229_1388, duration: 139496
2013-10-31 16:20:03,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:03,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000	dst=null	perm=null
2013-10-31 16:20:03,782 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56740, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6547866045732676229_1388, duration: 122542
2013-10-31 16:20:03,796 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004. blk_2111446225669027015_1401
2013-10-31 16:20:03,805 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003. blk_-6688585979939867207_1401
2013-10-31 16:20:03,822 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2111446225669027015_1401 src: /127.0.0.1:56741 dest: /127.0.0.1:41648
2013-10-31 16:20:03,823 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2111446225669027015_1401 src: /127.0.0.1:36707 dest: /127.0.0.1:38271
2013-10-31 16:20:03,824 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2111446225669027015_1401 src: /127.0.0.1:49741 dest: /127.0.0.1:47311
2013-10-31 16:20:03,826 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49741, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2111446225669027015_1401, duration: 992023
2013-10-31 16:20:03,826 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2111446225669027015_1401 terminating
2013-10-31 16:20:03,826 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36707, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2111446225669027015_1401, duration: 1413657
2013-10-31 16:20:03,827 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2111446225669027015_1401 terminating
2013-10-31 16:20:03,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6688585979939867207_1401 src: /127.0.0.1:56742 dest: /127.0.0.1:41648
2013-10-31 16:20:03,827 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56741, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2111446225669027015_1401, duration: 1844375
2013-10-31 16:20:03,827 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2111446225669027015_1401 terminating
2013-10-31 16:20:03,828 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6688585979939867207_1401 src: /127.0.0.1:36709 dest: /127.0.0.1:38271
2013-10-31 16:20:03,828 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6688585979939867207_1401 src: /127.0.0.1:49743 dest: /127.0.0.1:47311
2013-10-31 16:20:03,829 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2111446225669027015_1401 size 8
2013-10-31 16:20:03,830 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2111446225669027015_1401 size 8
2013-10-31 16:20:03,830 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2111446225669027015_1401 size 8
2013-10-31 16:20:03,830 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49743, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6688585979939867207_1401, duration: 1030446
2013-10-31 16:20:03,830 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6688585979939867207_1401 terminating
2013-10-31 16:20:03,831 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36709, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6688585979939867207_1401, duration: 1389338
2013-10-31 16:20:03,831 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6688585979939867207_1401 terminating
2013-10-31 16:20:03,831 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56742, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6688585979939867207_1401, duration: 1786294
2013-10-31 16:20:03,831 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6688585979939867207_1401 terminating
2013-10-31 16:20:03,832 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6688585979939867207_1401 size 8
2013-10-31 16:20:03,832 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0034_m_000003_0
2013-10-31 16:20:03,832 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0034_m_000003_0
2013-10-31 16:20:03,834 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6688585979939867207_1401 size 8
2013-10-31 16:20:03,835 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6688585979939867207_1401 size 8
2013-10-31 16:20:03,884 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:03,885 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000003_0 0.0% 
2013-10-31 16:20:04,056 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000000_0
2013-10-31 16:20:04,056 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000001_0
2013-10-31 16:20:04,100 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000002_0
2013-10-31 16:20:04,100 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000003_0
2013-10-31 16:20:04,229 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0034_m_000004_0
2013-10-31 16:20:04,230 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0034_m_000004_0
2013-10-31 16:20:04,301 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:04,301 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000004_0 0.0% 
2013-10-31 16:20:04,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0	dst=null	perm=null
2013-10-31 16:20:04,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:04,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:04,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0	dst=null	perm=null
2013-10-31 16:20:04,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0	dst=null	perm=null
2013-10-31 16:20:04,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:05,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0	dst=null	perm=null
2013-10-31 16:20:05,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0	dst=null	perm=null
2013-10-31 16:20:05,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:05,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:05,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:05,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:05,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:05,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0	dst=null	perm=null
2013-10-31 16:20:05,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0	dst=null	perm=null
2013-10-31 16:20:05,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0	dst=null	perm=null
2013-10-31 16:20:05,728 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:05,729 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000000_0 is done.
2013-10-31 16:20:05,729 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000000_0  was -1
2013-10-31 16:20:05,730 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:06,051 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0034_m_000006_0
2013-10-31 16:20:06,051 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0034_m_000006_0
2013-10-31 16:20:06,052 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000006_0 not found in cache
2013-10-31 16:20:06,199 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:20:06,201 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000002_0 is done.
2013-10-31 16:20:06,201 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000002_0  was -1
2013-10-31 16:20:06,202 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:06,420 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:20:06,421 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000003_0 is done.
2013-10-31 16:20:06,421 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000003_0  was -1
2013-10-31 16:20:06,421 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:07,059 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000000_0' has completed task_20131031160444934_0034_m_000000 successfully.
2013-10-31 16:20:07,104 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000002_0' has completed task_20131031160444934_0034_m_000002 successfully.
2013-10-31 16:20:07,106 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000003_0' has completed task_20131031160444934_0034_m_000003 successfully.
2013-10-31 16:20:07,108 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000004_0
2013-10-31 16:20:07,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0	dst=null	perm=null
2013-10-31 16:20:07,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:07,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:07,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0	dst=null	perm=null
2013-10-31 16:20:07,689 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:07,693 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:07,694 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000001_0 is done.
2013-10-31 16:20:07,694 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000001_0  was -1
2013-10-31 16:20:07,695 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:09,461 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:09,464 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:09,467 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000004_0 is done.
2013-10-31 16:20:09,468 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000004_0  was -1
2013-10-31 16:20:09,468 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:10,064 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000001_0' has completed task_20131031160444934_0034_m_000001 successfully.
2013-10-31 16:20:10,112 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000004_0' has completed task_20131031160444934_0034_m_000004 successfully.
2013-10-31 16:20:10,114 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0034_m_000005_0' to tip task_20131031160444934_0034_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:10,116 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:20:10,117 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000005_0 which needs 1 slots
2013-10-31 16:20:10,117 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000005_0 which needs 1 slots
2013-10-31 16:20:10,150 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_-478655554
2013-10-31 16:20:10,151 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_-478655554 spawned.
2013-10-31 16:20:10,152 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000005_0/taskjvm.sh
2013-10-31 16:20:11,082 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_-478655554 given task: attempt_20131031160444934_0034_m_000005_0
2013-10-31 16:20:11,588 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000005_0 0.0% 
2013-10-31 16:20:11,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary	dst=null	perm=null
2013-10-31 16:20:11,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:11,617 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_SUCCESS from client DFSClient_attempt_20131031160444934_0034_m_000005_0
2013-10-31 16:20:11,617 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0034_m_000005_0
2013-10-31 16:20:11,624 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1839156841999928741 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:11,624 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1839156841999928741 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:11,624 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1839156841999928741 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:11,624 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1839156841999928741 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:11,625 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2322401317774502462 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:11,625 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2322401317774502462 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:11,625 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2322401317774502462 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:11,625 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2322401317774502462 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:11,625 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5860927746139113368 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:11,625 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5860927746139113368 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:11,626 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5860927746139113368 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:11,626 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8691688367478710441 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:11,626 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8691688367478710441 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:11,626 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8691688367478710441 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:11,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034	dst=null	perm=null
2013-10-31 16:20:12,362 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-8691688367478710441_1393 blk_-2322401317774502462_1391 blk_-1839156841999928741_1390
2013-10-31 16:20:12,363 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-8691688367478710441_1393 blk_-2322401317774502462_1391 blk_-5860927746139113368_1392 blk_-1839156841999928741_1390
2013-10-31 16:20:12,532 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8691688367478710441_1393 file build/test/data/dfs/data/data3/current/blk_-8691688367478710441 for deletion
2013-10-31 16:20:12,532 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5860927746139113368_1392 file build/test/data/dfs/data/data4/current/blk_-5860927746139113368 for deletion
2013-10-31 16:20:12,532 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8691688367478710441_1393 at file build/test/data/dfs/data/data3/current/blk_-8691688367478710441
2013-10-31 16:20:12,533 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5860927746139113368_1392 at file build/test/data/dfs/data/data4/current/blk_-5860927746139113368
2013-10-31 16:20:12,532 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2322401317774502462_1391 file build/test/data/dfs/data/data3/current/blk_-2322401317774502462 for deletion
2013-10-31 16:20:12,533 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1839156841999928741_1390 file build/test/data/dfs/data/data4/current/blk_-1839156841999928741 for deletion
2013-10-31 16:20:12,534 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2322401317774502462_1391 at file build/test/data/dfs/data/data3/current/blk_-2322401317774502462
2013-10-31 16:20:12,534 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1839156841999928741_1390 at file build/test/data/dfs/data/data4/current/blk_-1839156841999928741
2013-10-31 16:20:13,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8691688367478710441_1393 file build/test/data/dfs/data/data6/current/blk_-8691688367478710441 for deletion
2013-10-31 16:20:13,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2322401317774502462_1391 file build/test/data/dfs/data/data5/current/blk_-2322401317774502462 for deletion
2013-10-31 16:20:13,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8691688367478710441_1393 at file build/test/data/dfs/data/data6/current/blk_-8691688367478710441
2013-10-31 16:20:13,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1839156841999928741_1390 file build/test/data/dfs/data/data6/current/blk_-1839156841999928741 for deletion
2013-10-31 16:20:13,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2322401317774502462_1391 at file build/test/data/dfs/data/data5/current/blk_-2322401317774502462
2013-10-31 16:20:13,150 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1839156841999928741_1390 at file build/test/data/dfs/data/data6/current/blk_-1839156841999928741
2013-10-31 16:20:14,523 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000005_0 0.0% cleanup
2013-10-31 16:20:14,525 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000005_0 is done.
2013-10-31 16:20:14,525 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000005_0  was -1
2013-10-31 16:20:14,526 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:15,363 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-2322401317774502462_1391 blk_-5860927746139113368_1392 blk_-1839156841999928741_1390
2013-10-31 16:20:15,363 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-8691688367478710441_1393 blk_-2322401317774502462_1391 blk_-5860927746139113368_1392 blk_-1839156841999928741_1390
2013-10-31 16:20:16,123 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000005_0' has completed task_20131031160444934_0034_m_000005 successfully.
2013-10-31 16:20:16,124 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0034 has completed successfully.
2013-10-31 16:20:16,125 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0034,submitTime=1383236393494,launchTime=1383236394425,firstMapTaskLaunchTime=1383236401047,firstJobSetupTaskLaunchTime=1383236395032,firstJobCleanupTaskLaunchTime=1383236410114,finishTime=1383236416124,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1686E7C7AC8C482C92D85BC9B258DF0C/B43CBD7F38E24877AF2CE749872D44CC] lhs*rhs/(1/2) ...orm/samepipearoundgroupby
2013-10-31 16:20:16,130 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877. blk_7392982790106358873_1402
2013-10-31 16:20:16,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7392982790106358873_1402 src: /127.0.0.1:36645 dest: /127.0.0.1:50942
2013-10-31 16:20:16,134 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7392982790106358873_1402 src: /127.0.0.1:36715 dest: /127.0.0.1:38271
2013-10-31 16:20:16,136 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7392982790106358873_1402 src: /127.0.0.1:49749 dest: /127.0.0.1:47311
2013-10-31 16:20:16,146 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49749, dest: /127.0.0.1:47311, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7392982790106358873_1402, duration: 5842388
2013-10-31 16:20:16,146 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7392982790106358873_1402 terminating
2013-10-31 16:20:16,147 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36715, dest: /127.0.0.1:38271, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7392982790106358873_1402, duration: 4174235
2013-10-31 16:20:16,147 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7392982790106358873_1402 terminating
2013-10-31 16:20:16,148 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36645, dest: /127.0.0.1:50942, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7392982790106358873_1402, duration: 6921536
2013-10-31 16:20:16,148 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7392982790106358873_1402 terminating
2013-10-31 16:20:16,154 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7392982790106358873_1402 size 26337
2013-10-31 16:20:16,154 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877 from client DFSClient_-1483996041
2013-10-31 16:20:16,155 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877 is closed by DFSClient_-1483996041
2013-10-31 16:20:16,155 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7392982790106358873_1402 size 26337
2013-10-31 16:20:16,156 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7392982790106358873_1402 size 26337
2013-10-31 16:20:16,163 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:20:16,164 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000004_0'
2013-10-31 16:20:16,164 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000005_0'
2013-10-31 16:20:16,166 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679661962309866501 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:16,171 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679661962309866501 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:16,171 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679661962309866501 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:16,173 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0034_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:20:16,176 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4238039309339233228 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:16,176 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4238039309339233228 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:16,177 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4238039309339233228 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:16,177 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-499582711603059738 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:16,177 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-499582711603059738 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:16,177 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-499582711603059738 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:16,177 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6547866045732676229 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:16,178 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6547866045732676229 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:16,178 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6547866045732676229 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:16,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034	dst=null	perm=null
2013-10-31 16:20:16,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0	dst=null	perm=null
2013-10-31 16:20:16,186 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary
2013-10-31 16:20:16,203 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0034
2013-10-31 16:20:16,203 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0034 being deleted.
2013-10-31 16:20:16,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2013-10-31 16:20:16,206 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:20:16,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2013-10-31 16:20:16,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2013-10-31 16:20:16,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2013-10-31 16:20:16,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2013-10-31 16:20:16,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2013-10-31 16:20:16,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2013-10-31 16:20:16,214 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56754, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1599467073490731312_1398, duration: 277147
2013-10-31 16:20:16,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2013-10-31 16:20:16,217 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49752, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-381001259991911914_1397, duration: 261816
2013-10-31 16:20:16,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2013-10-31 16:20:16,219 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56756, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5383765050450234615_1401, duration: 268423
2013-10-31 16:20:16,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2013-10-31 16:20:16,221 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36721, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6688585979939867207_1401, duration: 264868
2013-10-31 16:20:16,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2013-10-31 16:20:16,223 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56758, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2111446225669027015_1401, duration: 265389
2013-10-31 16:20:16,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2013-10-31 16:20:16,234 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:20:16,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2013-10-31 16:20:16,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2013-10-31 16:20:16,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2013-10-31 16:20:16,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2013-10-31 16:20:16,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2013-10-31 16:20:16,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2013-10-31 16:20:16,243 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36654, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1599467073490731312_1398, duration: 268884
2013-10-31 16:20:16,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2013-10-31 16:20:16,246 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49757, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-381001259991911914_1397, duration: 255385
2013-10-31 16:20:16,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2013-10-31 16:20:16,248 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49758, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5383765050450234615_1401, duration: 258235
2013-10-31 16:20:16,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2013-10-31 16:20:16,252 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56762, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6688585979939867207_1401, duration: 258134
2013-10-31 16:20:16,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2013-10-31 16:20:16,255 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36727, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2111446225669027015_1401, duration: 260667
2013-10-31 16:20:16,255 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/samepipearoundgroupby
2013-10-31 16:20:16,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2013-10-31 16:20:16,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2013-10-31 16:20:16,264 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56764, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1599467073490731312_1398, duration: 249066
2013-10-31 16:20:16,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2013-10-31 16:20:16,268 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49762, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-381001259991911914_1397, duration: 250269
2013-10-31 16:20:16,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2013-10-31 16:20:16,272 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49763, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5383765050450234615_1401, duration: 249560
2013-10-31 16:20:16,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2013-10-31 16:20:16,276 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56767, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6688585979939867207_1401, duration: 249697
2013-10-31 16:20:16,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2013-10-31 16:20:16,281 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49765, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2111446225669027015_1401, duration: 254135
2013-10-31 16:20:16,299 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:20:16,300 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:20:16,312 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] starting
2013-10-31 16:20:16,312 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:20:16,313 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2"]
2013-10-31 16:20:16,313 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  parallel execution is enabled: true
2013-10-31 16:20:16,313 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  starting jobs: 1
2013-10-31 16:20:16,313 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  allocating threads: 1
2013-10-31 16:20:16,314 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower] starting step: (1/1) ...edpipesplatform/samepipe2
2013-10-31 16:20:16,317 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:20:16,317 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:20:16,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:16,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:20:16,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,341 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar. blk_-829965190113103341_1403
2013-10-31 16:20:16,342 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-829965190113103341_1403 src: /127.0.0.1:49766 dest: /127.0.0.1:47311
2013-10-31 16:20:16,344 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-829965190113103341_1403 src: /127.0.0.1:56770 dest: /127.0.0.1:41648
2013-10-31 16:20:16,346 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-829965190113103341_1403 src: /127.0.0.1:36666 dest: /127.0.0.1:50942
2013-10-31 16:20:16,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36666, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-829965190113103341_1403, duration: 3806102
2013-10-31 16:20:16,354 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-829965190113103341_1403 terminating
2013-10-31 16:20:16,354 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-829965190113103341_1403 size 238055
2013-10-31 16:20:16,355 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56770, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-829965190113103341_1403, duration: 4631186
2013-10-31 16:20:16,355 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-829965190113103341_1403 terminating
2013-10-31 16:20:16,356 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49766, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-829965190113103341_1403, duration: 5736724
2013-10-31 16:20:16,356 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-829965190113103341_1403 terminating
2013-10-31 16:20:16,356 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-829965190113103341_1403 size 238055
2013-10-31 16:20:16,358 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar from client DFSClient_1457307213
2013-10-31 16:20:16,358 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar is closed by DFSClient_1457307213
2013-10-31 16:20:16,360 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-829965190113103341_1403 size 238055
2013-10-31 16:20:16,878 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar. New replication is 10
2013-10-31 16:20:16,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar	dst=null	perm=null
2013-10-31 16:20:16,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,894 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:20:16,898 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:20:16,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:16,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,917 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split. New replication is 10
2013-10-31 16:20:16,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split	dst=null	perm=null
2013-10-31 16:20:16,926 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split. blk_4490428191685297632_1404
2013-10-31 16:20:16,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4490428191685297632_1404 src: /127.0.0.1:49769 dest: /127.0.0.1:47311
2013-10-31 16:20:16,929 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4490428191685297632_1404 src: /127.0.0.1:36737 dest: /127.0.0.1:38271
2013-10-31 16:20:16,931 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4490428191685297632_1404 src: /127.0.0.1:36669 dest: /127.0.0.1:50942
2013-10-31 16:20:16,933 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4490428191685297632_1404 src: /127.0.0.1:56775 dest: /127.0.0.1:41648
2013-10-31 16:20:16,936 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56775, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4490428191685297632_1404, duration: 88019
2013-10-31 16:20:16,937 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4490428191685297632_1404 terminating
2013-10-31 16:20:16,937 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36669, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4490428191685297632_1404, duration: 913965
2013-10-31 16:20:16,937 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4490428191685297632_1404 terminating
2013-10-31 16:20:16,938 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4490428191685297632_1404 size 1732
2013-10-31 16:20:16,938 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36737, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4490428191685297632_1404, duration: 1867714
2013-10-31 16:20:16,939 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4490428191685297632_1404 terminating
2013-10-31 16:20:16,939 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4490428191685297632_1404 size 1732
2013-10-31 16:20:16,939 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49769, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4490428191685297632_1404, duration: 2959404
2013-10-31 16:20:16,939 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4490428191685297632_1404 size 1732
2013-10-31 16:20:16,940 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4490428191685297632_1404 terminating
2013-10-31 16:20:16,941 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4490428191685297632_1404 size 1732
2013-10-31 16:20:16,942 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split from client DFSClient_1457307213
2013-10-31 16:20:16,942 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split is closed by DFSClient_1457307213
2013-10-31 16:20:16,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,963 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo. blk_4927569461534459951_1405
2013-10-31 16:20:16,965 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4927569461534459951_1405 src: /127.0.0.1:36671 dest: /127.0.0.1:50942
2013-10-31 16:20:16,967 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4927569461534459951_1405 src: /127.0.0.1:56777 dest: /127.0.0.1:41648
2013-10-31 16:20:16,968 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4927569461534459951_1405 src: /127.0.0.1:36742 dest: /127.0.0.1:38271
2013-10-31 16:20:16,971 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36742, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4927569461534459951_1405, duration: 64327
2013-10-31 16:20:16,972 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4927569461534459951_1405 terminating
2013-10-31 16:20:16,972 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56777, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4927569461534459951_1405, duration: 852277
2013-10-31 16:20:16,973 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4927569461534459951_1405 terminating
2013-10-31 16:20:16,973 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36671, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4927569461534459951_1405, duration: 1694186
2013-10-31 16:20:16,974 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4927569461534459951_1405 terminating
2013-10-31 16:20:16,977 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4927569461534459951_1405 size 183
2013-10-31 16:20:16,977 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:20:16,978 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:20:16,978 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4927569461534459951_1405 size 183
2013-10-31 16:20:16,979 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4927569461534459951_1405 size 183
2013-10-31 16:20:16,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:17,004 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml. blk_6784548083507528066_1406
2013-10-31 16:20:17,005 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6784548083507528066_1406 src: /127.0.0.1:49776 dest: /127.0.0.1:47311
2013-10-31 16:20:17,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6784548083507528066_1406 src: /127.0.0.1:36675 dest: /127.0.0.1:50942
2013-10-31 16:20:17,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6784548083507528066_1406 src: /127.0.0.1:36745 dest: /127.0.0.1:38271
2013-10-31 16:20:17,012 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36745, dest: /127.0.0.1:38271, bytes: 27611, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6784548083507528066_1406, duration: 870554
2013-10-31 16:20:17,013 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6784548083507528066_1406 terminating
2013-10-31 16:20:17,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36675, dest: /127.0.0.1:50942, bytes: 27611, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6784548083507528066_1406, duration: 1704705
2013-10-31 16:20:17,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6784548083507528066_1406 terminating
2013-10-31 16:20:17,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49776, dest: /127.0.0.1:47311, bytes: 27611, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6784548083507528066_1406, duration: 2603806
2013-10-31 16:20:17,015 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6784548083507528066_1406 terminating
2013-10-31 16:20:17,016 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6784548083507528066_1406 size 27611
2013-10-31 16:20:17,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6784548083507528066_1406 size 27611
2013-10-31 16:20:17,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6784548083507528066_1406 size 27611
2013-10-31 16:20:17,018 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml from client DFSClient_1457307213
2013-10-31 16:20:17,018 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml is closed by DFSClient_1457307213
2013-10-31 16:20:17,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml	dst=null	perm=null
2013-10-31 16:20:17,031 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49780, bytes: 27827, op: HDFS_READ, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6784548083507528066_1406, duration: 451771
2013-10-31 16:20:17,038 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0035: nMaps=5 nReduces=0 max=-1
2013-10-31 16:20:17,039 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0035 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:20:17,039 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0035	RESULT=SUCCESS
2013-10-31 16:20:17,039 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0035
2013-10-31 16:20:17,039 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0035
2013-10-31 16:20:17,039 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower] submitted hadoop job: job_20131031160444934_0035
2013-10-31 16:20:17,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:17,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:17,072 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_conf.xml. blk_-8782215469058667875_1408
2013-10-31 16:20:17,073 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8782215469058667875_1408 src: /127.0.0.1:36748 dest: /127.0.0.1:38271
2013-10-31 16:20:17,075 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8782215469058667875_1408 src: /127.0.0.1:36680 dest: /127.0.0.1:50942
2013-10-31 16:20:17,077 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8782215469058667875_1408 src: /127.0.0.1:56786 dest: /127.0.0.1:41648
2013-10-31 16:20:17,081 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56786, dest: /127.0.0.1:41648, bytes: 27676, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8782215469058667875_1408, duration: 697233
2013-10-31 16:20:17,082 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8782215469058667875_1408 terminating
2013-10-31 16:20:17,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36680, dest: /127.0.0.1:50942, bytes: 27676, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8782215469058667875_1408, duration: 1516586
2013-10-31 16:20:17,083 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8782215469058667875_1408 terminating
2013-10-31 16:20:17,083 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36748, dest: /127.0.0.1:38271, bytes: 27676, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8782215469058667875_1408, duration: 2576509
2013-10-31 16:20:17,083 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8782215469058667875_1408 terminating
2013-10-31 16:20:17,085 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8782215469058667875_1408 size 27676
2013-10-31 16:20:17,086 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_conf.xml from client DFSClient_-604205094
2013-10-31 16:20:17,087 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_conf.xml is closed by DFSClient_-604205094
2013-10-31 16:20:17,087 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8782215469058667875_1408 size 27676
2013-10-31 16:20:17,087 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8782215469058667875_1408 size 27676
2013-10-31 16:20:17,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:17,580 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken. blk_-8369650424871952839_1409
2013-10-31 16:20:17,581 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8369650424871952839_1409 src: /127.0.0.1:36751 dest: /127.0.0.1:38271
2013-10-31 16:20:17,583 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8369650424871952839_1409 src: /127.0.0.1:36683 dest: /127.0.0.1:50942
2013-10-31 16:20:17,585 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8369650424871952839_1409 src: /127.0.0.1:56789 dest: /127.0.0.1:41648
2013-10-31 16:20:17,588 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56789, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8369650424871952839_1409, duration: 371945
2013-10-31 16:20:17,588 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8369650424871952839_1409 terminating
2013-10-31 16:20:17,589 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8369650424871952839_1409 size 116
2013-10-31 16:20:17,589 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36683, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8369650424871952839_1409, duration: 1134880
2013-10-31 16:20:17,589 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8369650424871952839_1409 terminating
2013-10-31 16:20:17,590 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36751, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8369650424871952839_1409, duration: 2059812
2013-10-31 16:20:17,591 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8369650424871952839_1409 terminating
2013-10-31 16:20:17,592 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8369650424871952839_1409 size 116
2013-10-31 16:20:17,593 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken from client DFSClient_1457307213
2013-10-31 16:20:17,593 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken is closed by DFSClient_1457307213
2013-10-31 16:20:17,594 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8369650424871952839_1409 size 116
2013-10-31 16:20:17,603 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken
2013-10-31 16:20:17,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:20:17,607 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36754, bytes: 187, op: HDFS_READ, cliID: DFSClient_-604205094, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4927569461534459951_1405, duration: 270443
2013-10-31 16:20:17,609 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0035 = 19. Number of splits = 5
2013-10-31 16:20:17,609 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,609 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,610 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,610 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,610 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,610 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,612 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,612 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,612 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,612 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,613 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0035 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:20:17,613 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0035 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:20:17,934 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8691688367478710441_1393 file build/test/data/dfs/data/data1/current/blk_-8691688367478710441 for deletion
2013-10-31 16:20:17,934 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5860927746139113368_1392 file build/test/data/dfs/data/data2/current/blk_-5860927746139113368 for deletion
2013-10-31 16:20:17,934 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8691688367478710441_1393 at file build/test/data/dfs/data/data1/current/blk_-8691688367478710441
2013-10-31 16:20:17,934 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2322401317774502462_1391 file build/test/data/dfs/data/data1/current/blk_-2322401317774502462 for deletion
2013-10-31 16:20:17,934 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5860927746139113368_1392 at file build/test/data/dfs/data/data2/current/blk_-5860927746139113368
2013-10-31 16:20:17,935 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2322401317774502462_1391 at file build/test/data/dfs/data/data1/current/blk_-2322401317774502462
2013-10-31 16:20:17,935 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1839156841999928741_1390 file build/test/data/dfs/data/data2/current/blk_-1839156841999928741 for deletion
2013-10-31 16:20:17,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1839156841999928741_1390 at file build/test/data/dfs/data/data2/current/blk_-1839156841999928741
2013-10-31 16:20:18,144 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5860927746139113368_1392 file build/test/data/dfs/data/data7/current/blk_-5860927746139113368 for deletion
2013-10-31 16:20:18,145 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2322401317774502462_1391 file build/test/data/dfs/data/data8/current/blk_-2322401317774502462 for deletion
2013-10-31 16:20:18,145 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5860927746139113368_1392 at file build/test/data/dfs/data/data7/current/blk_-5860927746139113368
2013-10-31 16:20:18,145 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1839156841999928741_1390 file build/test/data/dfs/data/data7/current/blk_-1839156841999928741 for deletion
2013-10-31 16:20:18,145 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2322401317774502462_1391 at file build/test/data/dfs/data/data8/current/blk_-2322401317774502462
2013-10-31 16:20:18,146 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1839156841999928741_1390 at file build/test/data/dfs/data/data7/current/blk_-1839156841999928741
2013-10-31 16:20:18,364 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-829965190113103341_1403 to datanode(s) 127.0.0.1:38271
2013-10-31 16:20:18,365 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-499582711603059738_1386 blk_6547866045732676229_1388 blk_4679661962309866501_1396
2013-10-31 16:20:18,365 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-499582711603059738_1386 blk_-4238039309339233228_1389 blk_4679661962309866501_1396
2013-10-31 16:20:18,534 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4238039309339233228_1389 file build/test/data/dfs/data/data3/current/blk_-4238039309339233228 for deletion
2013-10-31 16:20:18,534 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-499582711603059738_1386 file build/test/data/dfs/data/data4/current/blk_-499582711603059738 for deletion
2013-10-31 16:20:18,534 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4238039309339233228_1389 at file build/test/data/dfs/data/data3/current/blk_-4238039309339233228
2013-10-31 16:20:18,534 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679661962309866501_1396 file build/test/data/dfs/data/data3/current/blk_4679661962309866501 for deletion
2013-10-31 16:20:18,535 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-499582711603059738_1386 at file build/test/data/dfs/data/data4/current/blk_-499582711603059738
2013-10-31 16:20:18,535 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679661962309866501_1396 at file build/test/data/dfs/data/data3/current/blk_4679661962309866501
2013-10-31 16:20:19,078 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0035_m_000006_0' to tip task_20131031160444934_0035_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:19,082 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000000_0'
2013-10-31 16:20:19,082 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000001_0'
2013-10-31 16:20:19,083 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000006_0'
2013-10-31 16:20:19,084 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated InterTrackerProtocol.heartbeat 52 raw values into 15 aggregated values, total 15
2013-10-31 16:20:19,085 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:20:19,085 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000006_0 which needs 1 slots
2013-10-31 16:20:19,085 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000006_0 which needs 1 slots
2013-10-31 16:20:19,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken	dst=null	perm=null
2013-10-31 16:20:19,094 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36686, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8369650424871952839_1409, duration: 288981
2013-10-31 16:20:19,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml	dst=null	perm=null
2013-10-31 16:20:19,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36688, bytes: 27827, op: HDFS_READ, cliID: DFSClient_-2143966140, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6784548083507528066_1406, duration: 386777
2013-10-31 16:20:19,121 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000002_0'
2013-10-31 16:20:19,122 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000003_0'
2013-10-31 16:20:19,135 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:19,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar	dst=null	perm=null
2013-10-31 16:20:19,161 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56794, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2143966140, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-829965190113103341_1403, duration: 1244371
2013-10-31 16:20:19,255 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0034_m_29013589
2013-10-31 16:20:19,261 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31559 with signal TERM. Exit code 0
2013-10-31 16:20:19,262 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-234810922
2013-10-31 16:20:19,262 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-234810922 spawned.
2013-10-31 16:20:19,263 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000006_0/taskjvm.sh
2013-10-31 16:20:19,363 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:19,363 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:19,363 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:19,364 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_29013589 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:20,543 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-234810922 given task: attempt_20131031160444934_0035_m_000006_0
2013-10-31 16:20:21,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:21,144 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-829965190113103341_1403 to 127.0.0.1:38271 
2013-10-31 16:20:21,145 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-499582711603059738_1386 file build/test/data/dfs/data/data7/current/blk_-499582711603059738 for deletion
2013-10-31 16:20:21,146 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679661962309866501_1396 file build/test/data/dfs/data/data8/current/blk_4679661962309866501 for deletion
2013-10-31 16:20:21,146 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-499582711603059738_1386 at file build/test/data/dfs/data/data7/current/blk_-499582711603059738
2013-10-31 16:20:21,146 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6547866045732676229_1388 file build/test/data/dfs/data/data7/current/blk_6547866045732676229 for deletion
2013-10-31 16:20:21,146 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-829965190113103341_1403 to /127.0.0.1:38271
2013-10-31 16:20:21,146 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-829965190113103341_1403 src: /127.0.0.1:36761 dest: /127.0.0.1:38271
2013-10-31 16:20:21,146 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6547866045732676229_1388 at file build/test/data/dfs/data/data7/current/blk_6547866045732676229
2013-10-31 16:20:21,146 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679661962309866501_1396 at file build/test/data/dfs/data/data8/current/blk_4679661962309866501
2013-10-31 16:20:21,150 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-829965190113103341_1403 src: /127.0.0.1:36761 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:20:21,153 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-829965190113103341_1403 size 238055
2013-10-31 16:20:21,165 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0034
2013-10-31 16:20:21,166 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000005_0 not found in cache
2013-10-31 16:20:21,166 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000004_0 not found in cache
2013-10-31 16:20:21,167 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0034 for user-log deletion with retainTimeStamp:1383322821166
2013-10-31 16:20:21,366 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-499582711603059738_1386 blk_-4238039309339233228_1389 blk_6547866045732676229_1388
2013-10-31 16:20:21,366 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-4238039309339233228_1389 blk_6547866045732676229_1388 blk_4679661962309866501_1396
2013-10-31 16:20:22,010 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_-2125602537 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:22,021 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31675 with signal TERM. Exit code 0
2013-10-31 16:20:22,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4238039309339233228_1389 file build/test/data/dfs/data/data5/current/blk_-4238039309339233228 for deletion
2013-10-31 16:20:22,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-499582711603059738_1386 file build/test/data/dfs/data/data6/current/blk_-499582711603059738 for deletion
2013-10-31 16:20:22,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4238039309339233228_1389 at file build/test/data/dfs/data/data5/current/blk_-4238039309339233228
2013-10-31 16:20:22,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-499582711603059738_1386 at file build/test/data/dfs/data/data6/current/blk_-499582711603059738
2013-10-31 16:20:22,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6547866045732676229_1388 file build/test/data/dfs/data/data6/current/blk_6547866045732676229 for deletion
2013-10-31 16:20:22,153 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6547866045732676229_1388 at file build/test/data/dfs/data/data6/current/blk_6547866045732676229
2013-10-31 16:20:22,188 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:22,188 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:22,188 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:22,188 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_-2125602537 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:22,590 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_-478655554 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:22,600 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31894 with signal TERM. Exit code 0
2013-10-31 16:20:22,765 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:22,765 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:22,765 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:22,765 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_-478655554 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:23,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4238039309339233228_1389 file build/test/data/dfs/data/data1/current/blk_-4238039309339233228 for deletion
2013-10-31 16:20:23,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679661962309866501_1396 file build/test/data/dfs/data/data1/current/blk_4679661962309866501 for deletion
2013-10-31 16:20:23,936 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4238039309339233228_1389 at file build/test/data/dfs/data/data1/current/blk_-4238039309339233228
2013-10-31 16:20:23,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6547866045732676229_1388 file build/test/data/dfs/data/data2/current/blk_6547866045732676229 for deletion
2013-10-31 16:20:23,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679661962309866501_1396 at file build/test/data/dfs/data/data1/current/blk_4679661962309866501
2013-10-31 16:20:23,937 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6547866045732676229_1388 at file build/test/data/dfs/data/data2/current/blk_6547866045732676229
2013-10-31 16:20:24,005 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000006_0 0.0% setup
2013-10-31 16:20:24,007 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000006_0 is done.
2013-10-31 16:20:24,008 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000006_0  was -1
2013-10-31 16:20:24,008 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:24,085 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0034
2013-10-31 16:20:24,086 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000000_0 not found in cache
2013-10-31 16:20:24,086 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000001_0 not found in cache
2013-10-31 16:20:24,087 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0034 for user-log deletion with retainTimeStamp:1383322824087
2013-10-31 16:20:24,122 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0034
2013-10-31 16:20:24,123 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000002_0 not found in cache
2013-10-31 16:20:24,123 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000003_0 not found in cache
2013-10-31 16:20:24,124 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0034 for user-log deletion with retainTimeStamp:1383322824123
2013-10-31 16:20:24,736 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_408401697 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:24,746 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31401 with signal TERM. Exit code 0
2013-10-31 16:20:24,794 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_33509852 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:24,801 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31633 with signal TERM. Exit code 0
2013-10-31 16:20:24,924 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:24,924 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:24,924 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:24,924 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_408401697 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:20:24,979 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:24,979 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:24,979 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:24,980 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_33509852 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:24,996 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_-112746602 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:25,006 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31674 with signal TERM. Exit code 0
2013-10-31 16:20:25,091 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000006_0' has completed task_20131031160444934_0035_m_000006 successfully.
2013-10-31 16:20:25,094 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000000_0' to tip task_20131031160444934_0035_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:25,095 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000000
2013-10-31 16:20:25,096 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000001_0' to tip task_20131031160444934_0035_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:25,096 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000001
2013-10-31 16:20:25,098 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:20:25,100 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:20:25,100 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000000_0 which needs 1 slots
2013-10-31 16:20:25,100 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000000_0 which needs 1 slots
2013-10-31 16:20:25,101 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000001_0 which needs 1 slots
2013-10-31 16:20:25,101 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0035_m_000001_0 which needs 1 slots
2013-10-31 16:20:25,129 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000002_0' to tip task_20131031160444934_0035_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:25,130 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000002
2013-10-31 16:20:25,131 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000003_0' to tip task_20131031160444934_0035_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:25,131 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000003
2013-10-31 16:20:25,133 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:20:25,134 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:20:25,134 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000002_0 which needs 1 slots
2013-10-31 16:20:25,135 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000002_0 which needs 1 slots
2013-10-31 16:20:25,135 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000003_0 which needs 1 slots
2013-10-31 16:20:25,135 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0035_m_000003_0 which needs 1 slots
2013-10-31 16:20:25,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken	dst=null	perm=null
2013-10-31 16:20:25,144 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56798, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8369650424871952839_1409, duration: 293484
2013-10-31 16:20:25,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml	dst=null	perm=null
2013-10-31 16:20:25,151 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36764, bytes: 27827, op: HDFS_READ, cliID: DFSClient_-997578610, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6784548083507528066_1406, duration: 160380
2013-10-31 16:20:25,154 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-930299698
2013-10-31 16:20:25,154 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-930299698 spawned.
2013-10-31 16:20:25,155 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0035/attempt_20131031160444934_0035_m_000001_0. Attempting to reuse: jvm_20131031160444934_0035_m_-234810922
2013-10-31 16:20:25,156 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000000_0/taskjvm.sh
2013-10-31 16:20:25,164 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:25,173 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000004_0' to tip task_20131031160444934_0035_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:25,173 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000004
2013-10-31 16:20:25,174 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:20:25,175 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:25,175 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000004_0 which needs 1 slots
2013-10-31 16:20:25,175 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:25,175 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:25,175 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000004_0 which needs 1 slots
2013-10-31 16:20:25,175 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_-112746602 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:25,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar	dst=null	perm=null
2013-10-31 16:20:25,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken	dst=null	perm=null
2013-10-31 16:20:25,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56801, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-997578610, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-829965190113103341_1403, duration: 633392
2013-10-31 16:20:25,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36697, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8369650424871952839_1409, duration: 112592
2013-10-31 16:20:25,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml	dst=null	perm=null
2013-10-31 16:20:25,183 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36699, bytes: 27827, op: HDFS_READ, cliID: DFSClient_751365490, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6784548083507528066_1406, duration: 150037
2013-10-31 16:20:25,195 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:25,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar	dst=null	perm=null
2013-10-31 16:20:25,209 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49802, bytes: 239915, op: HDFS_READ, cliID: DFSClient_751365490, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-829965190113103341_1403, duration: 654064
2013-10-31 16:20:25,233 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-647659629
2013-10-31 16:20:25,233 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-647659629 spawned.
2013-10-31 16:20:25,235 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000003_0/taskjvm.sh
2013-10-31 16:20:25,236 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-1752688732
2013-10-31 16:20:25,236 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-1752688732 spawned.
2013-10-31 16:20:25,237 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000002_0/taskjvm.sh
2013-10-31 16:20:25,273 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-356651926
2013-10-31 16:20:25,275 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-356651926 spawned.
2013-10-31 16:20:25,277 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000004_0/taskjvm.sh
2013-10-31 16:20:25,562 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-234810922 given task: attempt_20131031160444934_0035_m_000001_0
2013-10-31 16:20:25,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split	dst=null	perm=null
2013-10-31 16:20:25,680 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36771, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4490428191685297632_1404, duration: 165753
2013-10-31 16:20:25,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:25,721 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49805, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 100029
2013-10-31 16:20:26,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:26,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:26,626 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001. blk_8838296772880953227_1410
2013-10-31 16:20:26,644 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838296772880953227_1410 src: /127.0.0.1:49806 dest: /127.0.0.1:47311
2013-10-31 16:20:26,645 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838296772880953227_1410 src: /127.0.0.1:36774 dest: /127.0.0.1:38271
2013-10-31 16:20:26,646 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838296772880953227_1410 src: /127.0.0.1:36707 dest: /127.0.0.1:50942
2013-10-31 16:20:26,648 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36707, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8838296772880953227_1410, duration: 1295433
2013-10-31 16:20:26,648 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8838296772880953227_1410 terminating
2013-10-31 16:20:26,648 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36774, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8838296772880953227_1410, duration: 1766577
2013-10-31 16:20:26,649 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8838296772880953227_1410 terminating
2013-10-31 16:20:26,649 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49806, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8838296772880953227_1410, duration: 2174307
2013-10-31 16:20:26,649 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8838296772880953227_1410 terminating
2013-10-31 16:20:26,650 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8838296772880953227_1410 size 8
2013-10-31 16:20:26,651 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0035_m_000001_0
2013-10-31 16:20:26,651 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0035_m_000001_0
2013-10-31 16:20:26,652 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8838296772880953227_1410 size 8
2013-10-31 16:20:26,653 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8838296772880953227_1410 size 8
2013-10-31 16:20:26,688 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:26,688 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000001_0 0.0% 
2013-10-31 16:20:27,195 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-356651926 given task: attempt_20131031160444934_0035_m_000004_0
2013-10-31 16:20:27,197 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-647659629 given task: attempt_20131031160444934_0035_m_000003_0
2013-10-31 16:20:27,208 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-1752688732 given task: attempt_20131031160444934_0035_m_000002_0
2013-10-31 16:20:27,209 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-930299698 given task: attempt_20131031160444934_0035_m_000000_0
2013-10-31 16:20:27,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split	dst=null	perm=null
2013-10-31 16:20:27,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split	dst=null	perm=null
2013-10-31 16:20:27,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split	dst=null	perm=null
2013-10-31 16:20:27,708 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56821, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4490428191685297632_1404, duration: 169058
2013-10-31 16:20:27,708 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36717, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4490428191685297632_1404, duration: 144331
2013-10-31 16:20:27,709 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49820, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4490428191685297632_1404, duration: 142307
2013-10-31 16:20:27,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split	dst=null	perm=null
2013-10-31 16:20:27,729 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36719, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4490428191685297632_1404, duration: 161867
2013-10-31 16:20:27,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:27,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:27,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:27,748 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49822, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 114004
2013-10-31 16:20:27,749 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36790, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 113341
2013-10-31 16:20:27,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:27,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:27,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:27,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:27,767 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49824, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 145340
2013-10-31 16:20:27,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:27,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:27,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:27,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:27,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:27,951 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36792, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 131512
2013-10-31 16:20:27,957 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000. blk_823550070109523503_1414
2013-10-31 16:20:27,957 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002. blk_-3412652135579097293_1414
2013-10-31 16:20:27,959 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003. blk_4361770873798175822_1414
2013-10-31 16:20:27,967 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004. blk_-3428262924556753517_1414
2013-10-31 16:20:27,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_823550070109523503_1414 src: /127.0.0.1:36793 dest: /127.0.0.1:38271
2013-10-31 16:20:27,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3412652135579097293_1414 src: /127.0.0.1:36794 dest: /127.0.0.1:38271
2013-10-31 16:20:27,981 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_823550070109523503_1414 src: /127.0.0.1:56833 dest: /127.0.0.1:41648
2013-10-31 16:20:27,981 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3412652135579097293_1414 src: /127.0.0.1:36729 dest: /127.0.0.1:50942
2013-10-31 16:20:27,984 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_823550070109523503_1414 src: /127.0.0.1:49833 dest: /127.0.0.1:47311
2013-10-31 16:20:27,984 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3412652135579097293_1414 src: /127.0.0.1:56835 dest: /127.0.0.1:41648
2013-10-31 16:20:27,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3428262924556753517_1414 src: /127.0.0.1:36727 dest: /127.0.0.1:50942
2013-10-31 16:20:27,992 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56835, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3412652135579097293_1414, duration: 3519876
2013-10-31 16:20:27,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4361770873798175822_1414 src: /127.0.0.1:36726 dest: /127.0.0.1:50942
2013-10-31 16:20:27,992 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3412652135579097293_1414 terminating
2013-10-31 16:20:27,992 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49833, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_823550070109523503_1414, duration: 5067011
2013-10-31 16:20:27,994 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3412652135579097293_1414 size 8
2013-10-31 16:20:27,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3428262924556753517_1414 src: /127.0.0.1:49834 dest: /127.0.0.1:47311
2013-10-31 16:20:27,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4361770873798175822_1414 src: /127.0.0.1:49835 dest: /127.0.0.1:47311
2013-10-31 16:20:27,994 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_823550070109523503_1414 size 8
2013-10-31 16:20:27,993 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36729, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3412652135579097293_1414, duration: 5355985
2013-10-31 16:20:27,994 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56833, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_823550070109523503_1414, duration: 7246876
2013-10-31 16:20:27,994 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_823550070109523503_1414 terminating
2013-10-31 16:20:27,996 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_823550070109523503_1414 terminating
2013-10-31 16:20:27,996 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36794, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3412652135579097293_1414, duration: 8408886
2013-10-31 16:20:27,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36793, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_823550070109523503_1414, duration: 8593221
2013-10-31 16:20:27,997 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3428262924556753517_1414 src: /127.0.0.1:36803 dest: /127.0.0.1:38271
2013-10-31 16:20:27,997 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_823550070109523503_1414 terminating
2013-10-31 16:20:27,996 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_823550070109523503_1414 size 8
2013-10-31 16:20:27,996 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3412652135579097293_1414 terminating
2013-10-31 16:20:27,997 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0035_m_000002_0
2013-10-31 16:20:27,997 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4361770873798175822_1414 src: /127.0.0.1:36804 dest: /127.0.0.1:38271
2013-10-31 16:20:27,997 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3412652135579097293_1414 terminating
2013-10-31 16:20:28,001 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0035_m_000002_0
2013-10-31 16:20:28,002 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0035_m_000000_0
2013-10-31 16:20:28,002 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36803, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3428262924556753517_1414, duration: 2048585
2013-10-31 16:20:28,004 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0035_m_000000_0
2013-10-31 16:20:28,004 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3428262924556753517_1414 terminating
2013-10-31 16:20:28,004 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3412652135579097293_1414 size 8
2013-10-31 16:20:28,005 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49834, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3428262924556753517_1414, duration: 3165766
2013-10-31 16:20:28,005 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36804, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4361770873798175822_1414, duration: 351961
2013-10-31 16:20:28,005 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3412652135579097293_1414 size 8
2013-10-31 16:20:28,005 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4361770873798175822_1414 terminating
2013-10-31 16:20:28,005 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3428262924556753517_1414 terminating
2013-10-31 16:20:28,005 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_823550070109523503_1414 size 8
2013-10-31 16:20:28,005 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36727, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3428262924556753517_1414, duration: 5005587
2013-10-31 16:20:28,005 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3428262924556753517_1414 size 8
2013-10-31 16:20:28,006 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3428262924556753517_1414 terminating
2013-10-31 16:20:28,006 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3428262924556753517_1414 size 8
2013-10-31 16:20:28,006 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49835, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4361770873798175822_1414, duration: 736795
2013-10-31 16:20:28,006 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4361770873798175822_1414 size 8
2013-10-31 16:20:28,006 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4361770873798175822_1414 terminating
2013-10-31 16:20:28,006 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3428262924556753517_1414 size 8
2013-10-31 16:20:28,007 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36726, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4361770873798175822_1414, duration: 2003694
2013-10-31 16:20:28,007 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4361770873798175822_1414 size 8
2013-10-31 16:20:28,007 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4361770873798175822_1414 terminating
2013-10-31 16:20:28,007 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4361770873798175822_1414 size 8
2013-10-31 16:20:28,007 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0035_m_000004_0
2013-10-31 16:20:28,008 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0035_m_000004_0
2013-10-31 16:20:28,008 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0035_m_000003_0
2013-10-31 16:20:28,008 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0035_m_000003_0
2013-10-31 16:20:28,076 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:28,076 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000002_0 0.0% 
2013-10-31 16:20:28,103 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000001_0
2013-10-31 16:20:28,137 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000002_0
2013-10-31 16:20:30,100 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0035_m_000006_0
2013-10-31 16:20:30,100 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0035_m_000006_0
2013-10-31 16:20:30,101 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000006_0 not found in cache
2013-10-31 16:20:30,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0	dst=null	perm=null
2013-10-31 16:20:30,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0	dst=null	perm=null
2013-10-31 16:20:30,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:30,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:30,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:30,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:30,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0	dst=null	perm=null
2013-10-31 16:20:30,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0	dst=null	perm=null
2013-10-31 16:20:30,361 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:30,361 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:30,361 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:30,361 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000000_0 0.0% 
2013-10-31 16:20:30,361 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000003_0 0.0% 
2013-10-31 16:20:30,361 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000004_0 0.0% 
2013-10-31 16:20:30,634 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:20:30,635 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000002_0 is done.
2013-10-31 16:20:30,636 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000002_0  was -1
2013-10-31 16:20:30,636 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:31,107 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000000_0
2013-10-31 16:20:31,140 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000002_0' has completed task_20131031160444934_0035_m_000002 successfully.
2013-10-31 16:20:31,142 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000003_0
2013-10-31 16:20:31,183 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000004_0
2013-10-31 16:20:31,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0	dst=null	perm=null
2013-10-31 16:20:31,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0	dst=null	perm=null
2013-10-31 16:20:31,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0	dst=null	perm=null
2013-10-31 16:20:31,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:31,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:31,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:31,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:31,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:31,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:31,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0	dst=null	perm=null
2013-10-31 16:20:31,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0	dst=null	perm=null
2013-10-31 16:20:31,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0	dst=null	perm=null
2013-10-31 16:20:31,689 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:31,693 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:31,695 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000001_0 is done.
2013-10-31 16:20:31,695 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000001_0  was -1
2013-10-31 16:20:31,695 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:33,684 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:33,685 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:20:33,686 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:33,686 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:20:33,687 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000000_0 is done.
2013-10-31 16:20:33,687 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000000_0  was -1
2013-10-31 16:20:33,687 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000003_0 is done.
2013-10-31 16:20:33,687 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:33,687 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000003_0  was -1
2013-10-31 16:20:33,687 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:33,693 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:33,695 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:33,696 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000004_0 is done.
2013-10-31 16:20:33,696 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000004_0  was -1
2013-10-31 16:20:33,696 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:34,111 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000000_0' has completed task_20131031160444934_0035_m_000000 successfully.
2013-10-31 16:20:34,112 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000001_0' has completed task_20131031160444934_0035_m_000001 successfully.
2013-10-31 16:20:34,145 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000003_0' has completed task_20131031160444934_0035_m_000003 successfully.
2013-10-31 16:20:34,185 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000004_0' has completed task_20131031160444934_0035_m_000004 successfully.
2013-10-31 16:20:34,188 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0035_m_000005_0' to tip task_20131031160444934_0035_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:34,191 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:20:34,191 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000005_0 which needs 1 slots
2013-10-31 16:20:34,191 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000005_0 which needs 1 slots
2013-10-31 16:20:34,229 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_877611637
2013-10-31 16:20:34,229 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_877611637 spawned.
2013-10-31 16:20:34,231 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000005_0/taskjvm.sh
2013-10-31 16:20:35,168 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_877611637 given task: attempt_20131031160444934_0035_m_000005_0
2013-10-31 16:20:35,645 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000005_0 0.0% 
2013-10-31 16:20:35,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary	dst=null	perm=null
2013-10-31 16:20:35,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:35,666 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_SUCCESS from client DFSClient_attempt_20131031160444934_0035_m_000005_0
2013-10-31 16:20:35,666 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0035_m_000005_0
2013-10-31 16:20:35,674 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-829965190113103341 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:35,674 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-829965190113103341 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:35,674 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-829965190113103341 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:35,675 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-829965190113103341 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:35,675 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4490428191685297632 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:35,675 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4490428191685297632 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:35,675 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4490428191685297632 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:35,675 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4490428191685297632 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:35,675 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4927569461534459951 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:35,676 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4927569461534459951 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:35,676 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4927569461534459951 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:35,676 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6784548083507528066 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:35,676 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6784548083507528066 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:35,676 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6784548083507528066 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:35,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035	dst=null	perm=null
2013-10-31 16:20:36,368 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_4927569461534459951_1405 blk_6784548083507528066_1406 blk_4490428191685297632_1404 blk_-829965190113103341_1403
2013-10-31 16:20:36,369 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_4927569461534459951_1405 blk_6784548083507528066_1406 blk_4490428191685297632_1404 blk_-829965190113103341_1403
2013-10-31 16:20:38,581 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000005_0 0.0% cleanup
2013-10-31 16:20:38,583 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000005_0 is done.
2013-10-31 16:20:38,583 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000005_0  was -1
2013-10-31 16:20:38,583 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:38,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-829965190113103341_1403 file build/test/data/dfs/data/data1/current/blk_-829965190113103341 for deletion
2013-10-31 16:20:38,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4490428191685297632_1404 file build/test/data/dfs/data/data2/current/blk_4490428191685297632 for deletion
2013-10-31 16:20:38,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-829965190113103341_1403 at file build/test/data/dfs/data/data1/current/blk_-829965190113103341
2013-10-31 16:20:38,942 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4490428191685297632_1404 at file build/test/data/dfs/data/data2/current/blk_4490428191685297632
2013-10-31 16:20:38,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4927569461534459951_1405 file build/test/data/dfs/data/data1/current/blk_4927569461534459951 for deletion
2013-10-31 16:20:38,942 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6784548083507528066_1406 file build/test/data/dfs/data/data2/current/blk_6784548083507528066 for deletion
2013-10-31 16:20:38,942 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4927569461534459951_1405 at file build/test/data/dfs/data/data1/current/blk_4927569461534459951
2013-10-31 16:20:38,943 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6784548083507528066_1406 at file build/test/data/dfs/data/data2/current/blk_6784548083507528066
2013-10-31 16:20:39,151 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-829965190113103341_1403 file build/test/data/dfs/data/data8/current/blk_-829965190113103341 for deletion
2013-10-31 16:20:39,151 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4490428191685297632_1404 file build/test/data/dfs/data/data7/current/blk_4490428191685297632 for deletion
2013-10-31 16:20:39,151 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4927569461534459951_1405 file build/test/data/dfs/data/data8/current/blk_4927569461534459951 for deletion
2013-10-31 16:20:39,151 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4490428191685297632_1404 at file build/test/data/dfs/data/data7/current/blk_4490428191685297632
2013-10-31 16:20:39,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6784548083507528066_1406 file build/test/data/dfs/data/data7/current/blk_6784548083507528066 for deletion
2013-10-31 16:20:39,151 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-829965190113103341_1403 at file build/test/data/dfs/data/data8/current/blk_-829965190113103341
2013-10-31 16:20:39,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6784548083507528066_1406 at file build/test/data/dfs/data/data7/current/blk_6784548083507528066
2013-10-31 16:20:39,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4927569461534459951_1405 at file build/test/data/dfs/data/data8/current/blk_4927569461534459951
2013-10-31 16:20:39,369 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_4927569461534459951_1405 blk_4490428191685297632_1404 blk_-829965190113103341_1403
2013-10-31 16:20:39,369 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_6784548083507528066_1406 blk_4490428191685297632_1404 blk_-829965190113103341_1403
2013-10-31 16:20:39,541 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-829965190113103341_1403 file build/test/data/dfs/data/data4/current/blk_-829965190113103341 for deletion
2013-10-31 16:20:39,541 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4490428191685297632_1404 file build/test/data/dfs/data/data3/current/blk_4490428191685297632 for deletion
2013-10-31 16:20:39,541 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-829965190113103341_1403 at file build/test/data/dfs/data/data4/current/blk_-829965190113103341
2013-10-31 16:20:39,542 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4490428191685297632_1404 at file build/test/data/dfs/data/data3/current/blk_4490428191685297632
2013-10-31 16:20:39,541 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6784548083507528066_1406 file build/test/data/dfs/data/data4/current/blk_6784548083507528066 for deletion
2013-10-31 16:20:39,542 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6784548083507528066_1406 at file build/test/data/dfs/data/data4/current/blk_6784548083507528066
2013-10-31 16:20:39,847 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:20:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,876 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,881 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,886 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,892 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,892 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:20:40,158 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-829965190113103341_1403 file build/test/data/dfs/data/data6/current/blk_-829965190113103341 for deletion
2013-10-31 16:20:40,158 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4490428191685297632_1404 file build/test/data/dfs/data/data5/current/blk_4490428191685297632 for deletion
2013-10-31 16:20:40,158 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-829965190113103341_1403 at file build/test/data/dfs/data/data6/current/blk_-829965190113103341
2013-10-31 16:20:40,159 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4490428191685297632_1404 at file build/test/data/dfs/data/data5/current/blk_4490428191685297632
2013-10-31 16:20:40,159 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4927569461534459951_1405 file build/test/data/dfs/data/data6/current/blk_4927569461534459951 for deletion
2013-10-31 16:20:40,159 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4927569461534459951_1405 at file build/test/data/dfs/data/data6/current/blk_4927569461534459951
2013-10-31 16:20:40,199 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000005_0' has completed task_20131031160444934_0035_m_000005 successfully.
2013-10-31 16:20:40,200 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0035 has completed successfully.
2013-10-31 16:20:40,200 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0035,submitTime=1383236417025,launchTime=1383236417613,firstMapTaskLaunchTime=1383236425094,firstJobSetupTaskLaunchTime=1383236419077,firstJobCleanupTaskLaunchTime=1383236434188,finishTime=1383236440200,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[6ABABDE7E439464AABFBD12003752CA1/237A17A3D2174464839B014948A9A81D] lower/(1/1) ...edpipesplatform/samepipe2
2013-10-31 16:20:40,208 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464. blk_-1006260212807991529_1415
2013-10-31 16:20:40,210 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1006260212807991529_1415 src: /127.0.0.1:36743 dest: /127.0.0.1:50942
2013-10-31 16:20:40,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1006260212807991529_1415 src: /127.0.0.1:49846 dest: /127.0.0.1:47311
2013-10-31 16:20:40,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1006260212807991529_1415 src: /127.0.0.1:56850 dest: /127.0.0.1:41648
2013-10-31 16:20:40,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56850, dest: /127.0.0.1:41648, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1006260212807991529_1415, duration: 6706778
2013-10-31 16:20:40,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1006260212807991529_1415 terminating
2013-10-31 16:20:40,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49846, dest: /127.0.0.1:47311, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1006260212807991529_1415, duration: 6675067
2013-10-31 16:20:40,225 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1006260212807991529_1415 terminating
2013-10-31 16:20:40,226 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1006260212807991529_1415 size 26335
2013-10-31 16:20:40,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36743, dest: /127.0.0.1:50942, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1006260212807991529_1415, duration: 6521641
2013-10-31 16:20:40,226 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1006260212807991529_1415 terminating
2013-10-31 16:20:40,229 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1006260212807991529_1415 size 26335
2013-10-31 16:20:40,230 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464 from client DFSClient_-604205094
2013-10-31 16:20:40,230 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464 is closed by DFSClient_-604205094
2013-10-31 16:20:40,231 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1006260212807991529_1415 size 26335
2013-10-31 16:20:40,742 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:20:40,743 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000004_0'
2013-10-31 16:20:40,743 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000005_0'
2013-10-31 16:20:40,745 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8369650424871952839 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:40,745 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8369650424871952839 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:40,746 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0035
2013-10-31 16:20:40,746 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8369650424871952839 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:40,746 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0035 being deleted.
2013-10-31 16:20:40,748 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0035_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:20:40,751 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary
2013-10-31 16:20:40,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035	dst=null	perm=null
2013-10-31 16:20:40,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2013-10-31 16:20:40,808 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:20:40,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2013-10-31 16:20:40,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2013-10-31 16:20:40,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2013-10-31 16:20:40,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2013-10-31 16:20:40,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2013-10-31 16:20:40,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2013-10-31 16:20:40,816 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56852, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_823550070109523503_1414, duration: 286480
2013-10-31 16:20:40,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2013-10-31 16:20:40,818 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36748, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8838296772880953227_1410, duration: 264060
2013-10-31 16:20:40,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2013-10-31 16:20:40,820 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36818, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3412652135579097293_1414, duration: 262427
2013-10-31 16:20:40,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2013-10-31 16:20:40,822 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36750, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4361770873798175822_1414, duration: 257731
2013-10-31 16:20:40,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2013-10-31 16:20:40,824 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36751, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3428262924556753517_1414, duration: 258892
2013-10-31 16:20:40,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2013-10-31 16:20:40,832 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:20:40,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2013-10-31 16:20:40,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2013-10-31 16:20:40,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2013-10-31 16:20:40,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2013-10-31 16:20:40,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2013-10-31 16:20:40,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2013-10-31 16:20:40,839 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49854, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_823550070109523503_1414, duration: 146841
2013-10-31 16:20:40,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2013-10-31 16:20:40,841 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49855, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8838296772880953227_1410, duration: 104959
2013-10-31 16:20:40,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2013-10-31 16:20:40,843 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36823, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3412652135579097293_1414, duration: 109454
2013-10-31 16:20:40,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2013-10-31 16:20:40,844 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36824, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4361770873798175822_1414, duration: 104724
2013-10-31 16:20:40,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2013-10-31 16:20:40,846 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36825, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3428262924556753517_1414, duration: 102724
2013-10-31 16:20:40,846 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/samepipe2
2013-10-31 16:20:40,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2013-10-31 16:20:40,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2013-10-31 16:20:40,851 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36826, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_823550070109523503_1414, duration: 114664
2013-10-31 16:20:40,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2013-10-31 16:20:40,853 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49860, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8838296772880953227_1410, duration: 104420
2013-10-31 16:20:40,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2013-10-31 16:20:40,855 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36828, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3412652135579097293_1414, duration: 105831
2013-10-31 16:20:40,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2013-10-31 16:20:40,857 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36760, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4361770873798175822_1414, duration: 102247
2013-10-31 16:20:40,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2013-10-31 16:20:40,860 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36830, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3428262924556753517_1414, duration: 101178
2013-10-31 16:20:40,873 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:20:40,874 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:20:40,888 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs] starting
2013-10-31 16:20:40,888 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:20:40,889 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3"]
2013-10-31 16:20:40,889 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs]  parallel execution is enabled: true
2013-10-31 16:20:40,889 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs]  starting jobs: 1
2013-10-31 16:20:40,890 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs]  allocating threads: 1
2013-10-31 16:20:40,891 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs] starting step: (1/1) ...edpipesplatform/samepipe3
2013-10-31 16:20:40,894 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:20:40,894 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:20:40,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:40,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:20:40,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:40,933 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar. blk_-5817354174245219485_1416
2013-10-31 16:20:40,935 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5817354174245219485_1416 src: /127.0.0.1:49864 dest: /127.0.0.1:47311
2013-10-31 16:20:40,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5817354174245219485_1416 src: /127.0.0.1:36832 dest: /127.0.0.1:38271
2013-10-31 16:20:40,939 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5817354174245219485_1416 src: /127.0.0.1:36764 dest: /127.0.0.1:50942
2013-10-31 16:20:40,946 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36764, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5817354174245219485_1416, duration: 3597155
2013-10-31 16:20:40,946 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5817354174245219485_1416 terminating
2013-10-31 16:20:40,947 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36832, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5817354174245219485_1416, duration: 5005320
2013-10-31 16:20:40,947 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5817354174245219485_1416 terminating
2013-10-31 16:20:40,948 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49864, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5817354174245219485_1416, duration: 5422965
2013-10-31 16:20:40,948 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5817354174245219485_1416 terminating
2013-10-31 16:20:40,950 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5817354174245219485_1416 size 238055
2013-10-31 16:20:40,950 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar from client DFSClient_1457307213
2013-10-31 16:20:40,951 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar is closed by DFSClient_1457307213
2013-10-31 16:20:40,951 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5817354174245219485_1416 size 238055
2013-10-31 16:20:40,952 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5817354174245219485_1416 size 238055
2013-10-31 16:20:40,961 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar. New replication is 10
2013-10-31 16:20:40,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar	dst=null	perm=null
2013-10-31 16:20:40,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:40,979 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:20:40,983 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:20:40,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:40,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,005 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split. New replication is 10
2013-10-31 16:20:41,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split	dst=null	perm=null
2013-10-31 16:20:41,012 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split. blk_3223268501587367091_1417
2013-10-31 16:20:41,014 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3223268501587367091_1417 src: /127.0.0.1:36834 dest: /127.0.0.1:38271
2013-10-31 16:20:41,016 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3223268501587367091_1417 src: /127.0.0.1:49868 dest: /127.0.0.1:47311
2013-10-31 16:20:41,017 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3223268501587367091_1417 src: /127.0.0.1:36767 dest: /127.0.0.1:50942
2013-10-31 16:20:41,019 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3223268501587367091_1417 src: /127.0.0.1:56873 dest: /127.0.0.1:41648
2013-10-31 16:20:41,022 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56873, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3223268501587367091_1417, duration: 1594024
2013-10-31 16:20:41,023 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3223268501587367091_1417 terminating
2013-10-31 16:20:41,023 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36767, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3223268501587367091_1417, duration: 1052361
2013-10-31 16:20:41,024 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3223268501587367091_1417 terminating
2013-10-31 16:20:41,024 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49868, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3223268501587367091_1417, duration: 1911216
2013-10-31 16:20:41,024 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3223268501587367091_1417 terminating
2013-10-31 16:20:41,025 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36834, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3223268501587367091_1417, duration: 3210186
2013-10-31 16:20:41,025 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3223268501587367091_1417 terminating
2013-10-31 16:20:41,028 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3223268501587367091_1417 size 1732
2013-10-31 16:20:41,029 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split from client DFSClient_1457307213
2013-10-31 16:20:41,029 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split is closed by DFSClient_1457307213
2013-10-31 16:20:41,029 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3223268501587367091_1417 size 1732
2013-10-31 16:20:41,030 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3223268501587367091_1417 size 1732
2013-10-31 16:20:41,030 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3223268501587367091_1417 size 1732
2013-10-31 16:20:41,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,053 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo. blk_1039536471123630660_1418
2013-10-31 16:20:41,054 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1039536471123630660_1418 src: /127.0.0.1:56874 dest: /127.0.0.1:41648
2013-10-31 16:20:41,056 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1039536471123630660_1418 src: /127.0.0.1:49872 dest: /127.0.0.1:47311
2013-10-31 16:20:41,058 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1039536471123630660_1418 src: /127.0.0.1:36840 dest: /127.0.0.1:38271
2013-10-31 16:20:41,061 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36840, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1039536471123630660_1418, duration: 64201
2013-10-31 16:20:41,061 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1039536471123630660_1418 terminating
2013-10-31 16:20:41,061 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49872, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1039536471123630660_1418, duration: 848077
2013-10-31 16:20:41,062 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1039536471123630660_1418 terminating
2013-10-31 16:20:41,062 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56874, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1039536471123630660_1418, duration: 1655389
2013-10-31 16:20:41,063 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1039536471123630660_1418 terminating
2013-10-31 16:20:41,067 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1039536471123630660_1418 size 183
2013-10-31 16:20:41,068 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:20:41,068 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:20:41,068 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1039536471123630660_1418 size 183
2013-10-31 16:20:41,069 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1039536471123630660_1418 size 183
2013-10-31 16:20:41,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,100 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml. blk_-8990161524735521721_1419
2013-10-31 16:20:41,102 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8990161524735521721_1419 src: /127.0.0.1:56877 dest: /127.0.0.1:41648
2013-10-31 16:20:41,104 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8990161524735521721_1419 src: /127.0.0.1:36773 dest: /127.0.0.1:50942
2013-10-31 16:20:41,105 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8990161524735521721_1419 src: /127.0.0.1:36843 dest: /127.0.0.1:38271
2013-10-31 16:20:41,108 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36843, dest: /127.0.0.1:38271, bytes: 27785, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8990161524735521721_1419, duration: 177498
2013-10-31 16:20:41,109 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8990161524735521721_1419 terminating
2013-10-31 16:20:41,109 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36773, dest: /127.0.0.1:50942, bytes: 27785, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8990161524735521721_1419, duration: 988231
2013-10-31 16:20:41,109 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8990161524735521721_1419 terminating
2013-10-31 16:20:41,110 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56877, dest: /127.0.0.1:41648, bytes: 27785, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8990161524735521721_1419, duration: 1937245
2013-10-31 16:20:41,110 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8990161524735521721_1419 terminating
2013-10-31 16:20:41,113 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8990161524735521721_1419 size 27785
2013-10-31 16:20:41,113 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml from client DFSClient_1457307213
2013-10-31 16:20:41,114 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml is closed by DFSClient_1457307213
2013-10-31 16:20:41,114 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8990161524735521721_1419 size 27785
2013-10-31 16:20:41,115 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8990161524735521721_1419 size 27785
2013-10-31 16:20:41,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml	dst=null	perm=null
2013-10-31 16:20:41,131 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36845, bytes: 28005, op: HDFS_READ, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8990161524735521721_1419, duration: 467054
2013-10-31 16:20:41,148 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0036: nMaps=5 nReduces=0 max=-1
2013-10-31 16:20:41,149 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0036 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:20:41,149 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0036	RESULT=SUCCESS
2013-10-31 16:20:41,149 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0036
2013-10-31 16:20:41,149 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0036
2013-10-31 16:20:41,149 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs] submitted hadoop job: job_20131031160444934_0036
2013-10-31 16:20:42,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:42,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:42,046 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_conf.xml. blk_-3248233357626245067_1421
2013-10-31 16:20:42,048 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3248233357626245067_1421 src: /127.0.0.1:36846 dest: /127.0.0.1:38271
2013-10-31 16:20:42,049 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3248233357626245067_1421 src: /127.0.0.1:56883 dest: /127.0.0.1:41648
2013-10-31 16:20:42,051 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3248233357626245067_1421 src: /127.0.0.1:36779 dest: /127.0.0.1:50942
2013-10-31 16:20:42,055 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36779, dest: /127.0.0.1:50942, bytes: 27850, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3248233357626245067_1421, duration: 626786
2013-10-31 16:20:42,056 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3248233357626245067_1421 terminating
2013-10-31 16:20:42,056 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3248233357626245067_1421 size 27850
2013-10-31 16:20:42,056 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56883, dest: /127.0.0.1:41648, bytes: 27850, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3248233357626245067_1421, duration: 1479704
2013-10-31 16:20:42,057 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3248233357626245067_1421 terminating
2013-10-31 16:20:42,057 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36846, dest: /127.0.0.1:38271, bytes: 27850, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3248233357626245067_1421, duration: 2583900
2013-10-31 16:20:42,058 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3248233357626245067_1421 terminating
2013-10-31 16:20:42,059 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3248233357626245067_1421 size 27850
2013-10-31 16:20:42,059 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_conf.xml from client DFSClient_-1735618845
2013-10-31 16:20:42,060 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_conf.xml is closed by DFSClient_-1735618845
2013-10-31 16:20:42,060 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3248233357626245067_1421 size 27850
2013-10-31 16:20:42,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:42,079 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken. blk_-8553465570091622260_1422
2013-10-31 16:20:42,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8553465570091622260_1422 src: /127.0.0.1:56885 dest: /127.0.0.1:41648
2013-10-31 16:20:42,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8553465570091622260_1422 src: /127.0.0.1:36850 dest: /127.0.0.1:38271
2013-10-31 16:20:42,084 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8553465570091622260_1422 src: /127.0.0.1:49884 dest: /127.0.0.1:47311
2013-10-31 16:20:42,087 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49884, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8553465570091622260_1422, duration: 62948
2013-10-31 16:20:42,089 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8553465570091622260_1422 terminating
2013-10-31 16:20:42,089 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36850, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8553465570091622260_1422, duration: 3215968
2013-10-31 16:20:42,090 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8553465570091622260_1422 terminating
2013-10-31 16:20:42,090 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56885, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8553465570091622260_1422, duration: 4172546
2013-10-31 16:20:42,091 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8553465570091622260_1422 size 116
2013-10-31 16:20:42,092 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8553465570091622260_1422 terminating
2013-10-31 16:20:42,093 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8553465570091622260_1422 size 116
2013-10-31 16:20:42,093 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken from client DFSClient_1457307213
2013-10-31 16:20:42,094 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken is closed by DFSClient_1457307213
2013-10-31 16:20:42,094 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8553465570091622260_1422 size 116
2013-10-31 16:20:42,100 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken
2013-10-31 16:20:42,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:20:42,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56888, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1039536471123630660_1418, duration: 280061
2013-10-31 16:20:42,106 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0036 = 19. Number of splits = 5
2013-10-31 16:20:42,106 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,106 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,108 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,108 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,108 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,108 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0036 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:20:42,110 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0036 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:20:42,370 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-5817354174245219485_1416 to datanode(s) 127.0.0.1:41648
2013-10-31 16:20:42,370 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-8369650424871952839_1409
2013-10-31 16:20:42,370 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-8369650424871952839_1409
2013-10-31 16:20:43,126 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0036_m_000006_0' to tip task_20131031160444934_0036_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:43,130 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000000_0'
2013-10-31 16:20:43,131 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000001_0'
2013-10-31 16:20:43,131 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000006_0'
2013-10-31 16:20:43,133 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:20:43,133 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000006_0 which needs 1 slots
2013-10-31 16:20:43,133 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000006_0 which needs 1 slots
2013-10-31 16:20:43,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken	dst=null	perm=null
2013-10-31 16:20:43,142 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56889, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8553465570091622260_1422, duration: 299437
2013-10-31 16:20:43,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml	dst=null	perm=null
2013-10-31 16:20:43,152 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56891, bytes: 28005, op: HDFS_READ, cliID: DFSClient_582461285, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8990161524735521721_1419, duration: 373095
2013-10-31 16:20:43,159 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000002_0'
2013-10-31 16:20:43,159 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000003_0'
2013-10-31 16:20:43,159 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8369650424871952839_1409 file build/test/data/dfs/data/data6/current/blk_-8369650424871952839 for deletion
2013-10-31 16:20:43,160 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8369650424871952839_1409 at file build/test/data/dfs/data/data6/current/blk_-8369650424871952839
2013-10-31 16:20:43,181 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:43,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar	dst=null	perm=null
2013-10-31 16:20:43,214 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36787, bytes: 239915, op: HDFS_READ, cliID: DFSClient_582461285, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5817354174245219485_1416, duration: 1658540
2013-10-31 16:20:43,307 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0035_m_-930299698
2013-10-31 16:20:43,314 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32253 with signal TERM. Exit code 0
2013-10-31 16:20:43,314 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_-1374678209
2013-10-31 16:20:43,315 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_-1374678209 spawned.
2013-10-31 16:20:43,316 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000006_0/taskjvm.sh
2013-10-31 16:20:43,388 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:43,388 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:43,388 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:43,388 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-930299698 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:44,936 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-1374678209 given task: attempt_20131031160444934_0036_m_000006_0
2013-10-31 16:20:44,942 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-5817354174245219485_1416 to 127.0.0.1:41648 
2013-10-31 16:20:44,944 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-5817354174245219485_1416 to /127.0.0.1:41648
2013-10-31 16:20:44,944 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5817354174245219485_1416 src: /127.0.0.1:56894 dest: /127.0.0.1:41648
2013-10-31 16:20:44,948 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5817354174245219485_1416 src: /127.0.0.1:56894 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:20:44,950 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5817354174245219485_1416 size 238055
2013-10-31 16:20:45,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8369650424871952839_1409 file build/test/data/dfs/data/data7/current/blk_-8369650424871952839 for deletion
2013-10-31 16:20:45,152 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8369650424871952839_1409 at file build/test/data/dfs/data/data7/current/blk_-8369650424871952839
2013-10-31 16:20:45,371 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-8369650424871952839_1409
2013-10-31 16:20:45,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:45,746 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0035
2013-10-31 16:20:45,746 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000005_0 not found in cache
2013-10-31 16:20:45,746 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000004_0 not found in cache
2013-10-31 16:20:45,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0035 for user-log deletion with retainTimeStamp:1383322845747
2013-10-31 16:20:46,230 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_-356651926 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:46,243 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32254 with signal TERM. Exit code 0
2013-10-31 16:20:46,429 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:46,429 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:46,430 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:46,430 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-356651926 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:46,649 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_877611637 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:46,658 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32555 with signal TERM. Exit code 0
2013-10-31 16:20:46,823 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:46,824 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:46,824 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:46,824 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_877611637 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:47,944 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8369650424871952839_1409 file build/test/data/dfs/data/data2/current/blk_-8369650424871952839 for deletion
2013-10-31 16:20:47,944 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8369650424871952839_1409 at file build/test/data/dfs/data/data2/current/blk_-8369650424871952839
2013-10-31 16:20:48,133 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0035
2013-10-31 16:20:48,134 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000001_0 not found in cache
2013-10-31 16:20:48,134 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000000_0 not found in cache
2013-10-31 16:20:48,134 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0035 for user-log deletion with retainTimeStamp:1383322848134
2013-10-31 16:20:48,160 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0035
2013-10-31 16:20:48,160 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000002_0 not found in cache
2013-10-31 16:20:48,160 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000003_0 not found in cache
2013-10-31 16:20:48,161 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0035 for user-log deletion with retainTimeStamp:1383322848160
2013-10-31 16:20:48,395 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000006_0 0.0% setup
2013-10-31 16:20:48,398 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000006_0 is done.
2013-10-31 16:20:48,398 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000006_0  was -1
2013-10-31 16:20:48,398 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:48,736 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_-234810922 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:48,743 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32065 with signal TERM. Exit code 0
2013-10-31 16:20:48,943 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:48,943 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:48,943 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:48,944 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-234810922 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:20:49,139 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000006_0' has completed task_20131031160444934_0036_m_000006 successfully.
2013-10-31 16:20:49,143 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000000_0' to tip task_20131031160444934_0036_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:49,144 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000000
2013-10-31 16:20:49,144 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000001_0' to tip task_20131031160444934_0036_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:49,145 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000001
2013-10-31 16:20:49,147 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:20:49,148 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:20:49,148 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000000_0 which needs 1 slots
2013-10-31 16:20:49,148 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000000_0 which needs 1 slots
2013-10-31 16:20:49,149 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000001_0 which needs 1 slots
2013-10-31 16:20:49,149 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0036_m_000001_0 which needs 1 slots
2013-10-31 16:20:49,167 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000002_0' to tip task_20131031160444934_0036_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:49,167 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000002
2013-10-31 16:20:49,168 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000003_0' to tip task_20131031160444934_0036_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:49,168 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000003
2013-10-31 16:20:49,170 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:20:49,171 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:20:49,172 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000002_0 which needs 1 slots
2013-10-31 16:20:49,172 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000002_0 which needs 1 slots
2013-10-31 16:20:49,172 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000003_0 which needs 1 slots
2013-10-31 16:20:49,173 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0036_m_000003_0 which needs 1 slots
2013-10-31 16:20:49,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken	dst=null	perm=null
2013-10-31 16:20:49,181 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36860, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8553465570091622260_1422, duration: 300085
2013-10-31 16:20:49,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml	dst=null	perm=null
2013-10-31 16:20:49,189 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36793, bytes: 28005, op: HDFS_READ, cliID: DFSClient_-1807724398, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8990161524735521721_1419, duration: 158804
2013-10-31 16:20:49,191 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_-1410338411
2013-10-31 16:20:49,192 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_-1410338411 spawned.
2013-10-31 16:20:49,193 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0036/attempt_20131031160444934_0036_m_000000_0. Attempting to reuse: jvm_20131031160444934_0036_m_-1374678209
2013-10-31 16:20:49,193 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000001_0/taskjvm.sh
2013-10-31 16:20:49,201 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-1374678209 given task: attempt_20131031160444934_0036_m_000000_0
2013-10-31 16:20:49,209 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_-1752688732 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:49,217 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32252 with signal TERM. Exit code 0
2013-10-31 16:20:49,221 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_-647659629 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:49,234 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32251 with signal TERM. Exit code 0
2013-10-31 16:20:49,297 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:49,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split	dst=null	perm=null
2013-10-31 16:20:49,308 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56900, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3223268501587367091_1417, duration: 168016
2013-10-31 16:20:49,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar	dst=null	perm=null
2013-10-31 16:20:49,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36796, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1807724398, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5817354174245219485_1416, duration: 622051
2013-10-31 16:20:49,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:49,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:49,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:49,387 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:49,388 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:49,388 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:49,388 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-1752688732 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:49,400 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:49,400 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:49,400 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:20:49,400 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-647659629 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:49,406 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_764575079
2013-10-31 16:20:49,406 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_764575079 spawned.
2013-10-31 16:20:49,406 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_986697684
2013-10-31 16:20:49,407 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_986697684 spawned.
2013-10-31 16:20:49,408 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000002_0/taskjvm.sh
2013-10-31 16:20:49,408 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000003_0/taskjvm.sh
2013-10-31 16:20:49,636 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36866, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 127198
2013-10-31 16:20:49,643 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000. blk_1303671696596010570_1423
2013-10-31 16:20:49,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1303671696596010570_1423 src: /127.0.0.1:49900 dest: /127.0.0.1:47311
2013-10-31 16:20:49,717 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1303671696596010570_1423 src: /127.0.0.1:56904 dest: /127.0.0.1:41648
2013-10-31 16:20:49,718 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1303671696596010570_1423 src: /127.0.0.1:36800 dest: /127.0.0.1:50942
2013-10-31 16:20:49,735 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36800, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1303671696596010570_1423, duration: 16182776
2013-10-31 16:20:49,736 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1303671696596010570_1423 terminating
2013-10-31 16:20:49,736 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56904, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1303671696596010570_1423, duration: 16830990
2013-10-31 16:20:49,737 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1303671696596010570_1423 size 8
2013-10-31 16:20:49,737 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1303671696596010570_1423 terminating
2013-10-31 16:20:49,738 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49900, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1303671696596010570_1423, duration: 18324371
2013-10-31 16:20:49,738 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1303671696596010570_1423 terminating
2013-10-31 16:20:49,739 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1303671696596010570_1423 size 8
2013-10-31 16:20:49,740 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1303671696596010570_1423 size 8
2013-10-31 16:20:49,744 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0036_m_000000_0
2013-10-31 16:20:49,744 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0036_m_000000_0
2013-10-31 16:20:49,752 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000004_0' to tip task_20131031160444934_0036_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:49,753 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000004
2013-10-31 16:20:49,755 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:20:49,755 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000004_0 which needs 1 slots
2013-10-31 16:20:49,756 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000004_0 which needs 1 slots
2013-10-31 16:20:49,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken	dst=null	perm=null
2013-10-31 16:20:49,763 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56906, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8553465570091622260_1422, duration: 270922
2013-10-31 16:20:49,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml	dst=null	perm=null
2013-10-31 16:20:49,770 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36803, bytes: 28005, op: HDFS_READ, cliID: DFSClient_-10811922, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8990161524735521721_1419, duration: 164976
2013-10-31 16:20:49,784 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:49,785 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000000_0 0.0% 
2013-10-31 16:20:49,791 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:49,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar	dst=null	perm=null
2013-10-31 16:20:49,805 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49906, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-10811922, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5817354174245219485_1416, duration: 592264
2013-10-31 16:20:49,856 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_-2008477174
2013-10-31 16:20:49,857 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_-2008477174 spawned.
2013-10-31 16:20:49,858 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000004_0/taskjvm.sh
2013-10-31 16:20:50,116 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-1410338411 given task: attempt_20131031160444934_0036_m_000001_0
2013-10-31 16:20:50,510 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_764575079 given task: attempt_20131031160444934_0036_m_000002_0
2013-10-31 16:20:50,528 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_986697684 given task: attempt_20131031160444934_0036_m_000003_0
2013-10-31 16:20:50,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split	dst=null	perm=null
2013-10-31 16:20:50,619 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49911, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3223268501587367091_1417, duration: 163941
2013-10-31 16:20:50,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:50,659 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36810, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 141134
2013-10-31 16:20:50,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:50,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:50,856 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001. blk_8735242422086387614_1424
2013-10-31 16:20:50,890 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8735242422086387614_1424 src: /127.0.0.1:56916 dest: /127.0.0.1:41648
2013-10-31 16:20:50,891 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8735242422086387614_1424 src: /127.0.0.1:36812 dest: /127.0.0.1:50942
2013-10-31 16:20:50,892 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8735242422086387614_1424 src: /127.0.0.1:36882 dest: /127.0.0.1:38271
2013-10-31 16:20:50,894 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36882, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8735242422086387614_1424, duration: 1133648
2013-10-31 16:20:50,895 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8735242422086387614_1424 terminating
2013-10-31 16:20:50,895 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8735242422086387614_1424 size 8
2013-10-31 16:20:50,895 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36812, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8735242422086387614_1424, duration: 1668647
2013-10-31 16:20:50,895 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8735242422086387614_1424 terminating
2013-10-31 16:20:50,895 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56916, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8735242422086387614_1424, duration: 2061573
2013-10-31 16:20:50,896 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8735242422086387614_1424 size 8
2013-10-31 16:20:50,896 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8735242422086387614_1424 terminating
2013-10-31 16:20:50,896 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0036_m_000001_0
2013-10-31 16:20:50,897 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0036_m_000001_0
2013-10-31 16:20:50,898 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8735242422086387614_1424 size 8
2013-10-31 16:20:50,951 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:50,951 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000001_0 0.0% 
2013-10-31 16:20:51,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split	dst=null	perm=null
2013-10-31 16:20:51,037 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36817, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3223268501587367091_1417, duration: 168791
2013-10-31 16:20:51,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split	dst=null	perm=null
2013-10-31 16:20:51,044 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36818, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3223268501587367091_1417, duration: 146448
2013-10-31 16:20:51,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:51,077 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49921, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 115240
2013-10-31 16:20:51,079 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-2008477174 given task: attempt_20131031160444934_0036_m_000004_0
2013-10-31 16:20:51,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:51,085 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49922, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 133084
2013-10-31 16:20:51,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:51,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:51,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:51,335 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002. blk_3563163408596565662_1426
2013-10-31 16:20:51,358 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3563163408596565662_1426 src: /127.0.0.1:56926 dest: /127.0.0.1:41648
2013-10-31 16:20:51,362 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3563163408596565662_1426 src: /127.0.0.1:36891 dest: /127.0.0.1:38271
2013-10-31 16:20:51,363 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3563163408596565662_1426 src: /127.0.0.1:36823 dest: /127.0.0.1:50942
2013-10-31 16:20:51,365 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36823, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3563163408596565662_1426, duration: 1075504
2013-10-31 16:20:51,365 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3563163408596565662_1426 terminating
2013-10-31 16:20:51,366 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36891, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3563163408596565662_1426, duration: 1432212
2013-10-31 16:20:51,366 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3563163408596565662_1426 terminating
2013-10-31 16:20:51,366 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3563163408596565662_1426 size 8
2013-10-31 16:20:51,366 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56926, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3563163408596565662_1426, duration: 1882477
2013-10-31 16:20:51,367 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3563163408596565662_1426 terminating
2013-10-31 16:20:51,367 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3563163408596565662_1426 size 8
2013-10-31 16:20:51,367 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0036_m_000002_0
2013-10-31 16:20:51,368 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0036_m_000002_0
2013-10-31 16:20:51,369 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3563163408596565662_1426 size 8
2013-10-31 16:20:51,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:51,523 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:51,523 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000002_0 0.0% 
2013-10-31 16:20:51,643 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003. blk_-6798991363969057773_1426
2013-10-31 16:20:51,665 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6798991363969057773_1426 src: /127.0.0.1:36824 dest: /127.0.0.1:50942
2013-10-31 16:20:51,666 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6798991363969057773_1426 src: /127.0.0.1:56931 dest: /127.0.0.1:41648
2013-10-31 16:20:51,667 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6798991363969057773_1426 src: /127.0.0.1:49929 dest: /127.0.0.1:47311
2013-10-31 16:20:51,669 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49929, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6798991363969057773_1426, duration: 1125500
2013-10-31 16:20:51,670 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6798991363969057773_1426 terminating
2013-10-31 16:20:51,670 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56931, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6798991363969057773_1426, duration: 1504079
2013-10-31 16:20:51,670 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6798991363969057773_1426 terminating
2013-10-31 16:20:51,670 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36824, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6798991363969057773_1426, duration: 1888096
2013-10-31 16:20:51,670 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6798991363969057773_1426 terminating
2013-10-31 16:20:51,670 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6798991363969057773_1426 size 8
2013-10-31 16:20:51,671 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0036_m_000003_0
2013-10-31 16:20:51,671 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0036_m_000003_0
2013-10-31 16:20:51,673 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6798991363969057773_1426 size 8
2013-10-31 16:20:51,674 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6798991363969057773_1426 size 8
2013-10-31 16:20:51,719 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:51,720 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000003_0 0.0% 
2013-10-31 16:20:51,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split	dst=null	perm=null
2013-10-31 16:20:51,737 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36828, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3223268501587367091_1417, duration: 163461
2013-10-31 16:20:51,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:20:51,776 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36898, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 256201
2013-10-31 16:20:51,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:51,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:51,984 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004. blk_-115642158726394487_1427
2013-10-31 16:20:52,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-115642158726394487_1427 src: /127.0.0.1:49932 dest: /127.0.0.1:47311
2013-10-31 16:20:52,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-115642158726394487_1427 src: /127.0.0.1:36900 dest: /127.0.0.1:38271
2013-10-31 16:20:52,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-115642158726394487_1427 src: /127.0.0.1:56937 dest: /127.0.0.1:41648
2013-10-31 16:20:52,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56937, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-115642158726394487_1427, duration: 1419748
2013-10-31 16:20:52,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-115642158726394487_1427 terminating
2013-10-31 16:20:52,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36900, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-115642158726394487_1427, duration: 1773077
2013-10-31 16:20:52,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-115642158726394487_1427 terminating
2013-10-31 16:20:52,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49932, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-115642158726394487_1427, duration: 2178708
2013-10-31 16:20:52,015 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-115642158726394487_1427 terminating
2013-10-31 16:20:52,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-115642158726394487_1427 size 8
2013-10-31 16:20:52,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-115642158726394487_1427 size 8
2013-10-31 16:20:52,018 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-115642158726394487_1427 size 8
2013-10-31 16:20:52,152 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000000_0
2013-10-31 16:20:52,152 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000001_0
2013-10-31 16:20:52,174 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000002_0
2013-10-31 16:20:52,174 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000003_0
2013-10-31 16:20:52,417 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0036_m_000004_0
2013-10-31 16:20:52,417 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0036_m_000004_0
2013-10-31 16:20:52,481 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:52,481 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000004_0 0.0% 
2013-10-31 16:20:52,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0	dst=null	perm=null
2013-10-31 16:20:52,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:52,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:52,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0	dst=null	perm=null
2013-10-31 16:20:52,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0	dst=null	perm=null
2013-10-31 16:20:52,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:52,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:52,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0	dst=null	perm=null
2013-10-31 16:20:52,760 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000004_0
2013-10-31 16:20:52,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0	dst=null	perm=null
2013-10-31 16:20:52,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:52,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:52,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0	dst=null	perm=null
2013-10-31 16:20:52,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0	dst=null	perm=null
2013-10-31 16:20:52,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:52,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:52,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0	dst=null	perm=null
2013-10-31 16:20:53,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0	dst=null	perm=null
2013-10-31 16:20:53,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:53,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:53,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0	dst=null	perm=null
2013-10-31 16:20:53,536 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:53,538 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000001_0 is done.
2013-10-31 16:20:53,538 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000001_0  was -1
2013-10-31 16:20:53,539 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:53,949 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:20:53,951 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000002_0 is done.
2013-10-31 16:20:53,951 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000002_0  was -1
2013-10-31 16:20:53,952 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:53,969 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:20:53,970 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000003_0 is done.
2013-10-31 16:20:53,970 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000003_0  was -1
2013-10-31 16:20:53,970 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:54,148 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0036_m_000006_0
2013-10-31 16:20:54,148 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0036_m_000006_0
2013-10-31 16:20:54,148 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000006_0 not found in cache
2013-10-31 16:20:54,667 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:54,669 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000004_0 is done.
2013-10-31 16:20:54,669 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000004_0  was -1
2013-10-31 16:20:54,669 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:55,155 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000001_0' has completed task_20131031160444934_0036_m_000001 successfully.
2013-10-31 16:20:55,178 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000002_0' has completed task_20131031160444934_0036_m_000002 successfully.
2013-10-31 16:20:55,179 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000003_0' has completed task_20131031160444934_0036_m_000003 successfully.
2013-10-31 16:20:55,315 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:55,319 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:55,320 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000000_0 is done.
2013-10-31 16:20:55,320 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000000_0  was -1
2013-10-31 16:20:55,320 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:55,764 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000004_0' has completed task_20131031160444934_0036_m_000004 successfully.
2013-10-31 16:20:58,161 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000000_0' has completed task_20131031160444934_0036_m_000000 successfully.
2013-10-31 16:20:58,163 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0036_m_000005_0' to tip task_20131031160444934_0036_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:58,166 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:20:58,166 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000005_0 which needs 1 slots
2013-10-31 16:20:58,166 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000005_0 which needs 1 slots
2013-10-31 16:20:58,197 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0036/attempt_20131031160444934_0036_m_000005_0. Attempting to reuse: jvm_20131031160444934_0036_m_-1374678209
2013-10-31 16:20:58,853 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-1374678209 given task: attempt_20131031160444934_0036_m_000005_0
2013-10-31 16:20:58,949 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000005_0 0.0% 
2013-10-31 16:20:59,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary	dst=null	perm=null
2013-10-31 16:20:59,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:59,191 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_SUCCESS from client DFSClient_attempt_20131031160444934_0036_m_000005_0
2013-10-31 16:20:59,191 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0036_m_000005_0
2013-10-31 16:20:59,200 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5817354174245219485 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:59,200 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5817354174245219485 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:59,201 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5817354174245219485 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:59,201 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5817354174245219485 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:59,201 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3223268501587367091 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:59,201 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3223268501587367091 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:59,202 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3223268501587367091 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:59,202 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3223268501587367091 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:59,202 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1039536471123630660 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:59,202 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1039536471123630660 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:59,202 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1039536471123630660 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:59,203 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8990161524735521721 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:59,203 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8990161524735521721 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:59,203 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8990161524735521721 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:59,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036	dst=null	perm=null
2013-10-31 16:21:00,373 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_3223268501587367091_1417 blk_1039536471123630660_1418 blk_-5817354174245219485_1416 blk_-8990161524735521721_1419
2013-10-31 16:21:00,373 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_3223268501587367091_1417 blk_1039536471123630660_1418 blk_-5817354174245219485_1416 blk_-8990161524735521721_1419
2013-10-31 16:21:01,165 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8990161524735521721_1419 file build/test/data/dfs/data/data6/current/blk_-8990161524735521721 for deletion
2013-10-31 16:21:01,165 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5817354174245219485_1416 file build/test/data/dfs/data/data5/current/blk_-5817354174245219485 for deletion
2013-10-31 16:21:01,165 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8990161524735521721_1419 at file build/test/data/dfs/data/data6/current/blk_-8990161524735521721
2013-10-31 16:21:01,167 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1039536471123630660_1418 file build/test/data/dfs/data/data5/current/blk_1039536471123630660 for deletion
2013-10-31 16:21:01,167 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5817354174245219485_1416 at file build/test/data/dfs/data/data5/current/blk_-5817354174245219485
2013-10-31 16:21:01,168 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3223268501587367091_1417 file build/test/data/dfs/data/data6/current/blk_3223268501587367091 for deletion
2013-10-31 16:21:01,168 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1039536471123630660_1418 at file build/test/data/dfs/data/data5/current/blk_1039536471123630660
2013-10-31 16:21:01,168 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3223268501587367091_1417 at file build/test/data/dfs/data/data6/current/blk_3223268501587367091
2013-10-31 16:21:01,922 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000005_0 0.0% cleanup
2013-10-31 16:21:01,923 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000005_0 is done.
2013-10-31 16:21:01,923 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000005_0  was -1
2013-10-31 16:21:01,923 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:02,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8990161524735521721_1419 file build/test/data/dfs/data/data2/current/blk_-8990161524735521721 for deletion
2013-10-31 16:21:02,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5817354174245219485_1416 file build/test/data/dfs/data/data1/current/blk_-5817354174245219485 for deletion
2013-10-31 16:21:02,949 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8990161524735521721_1419 at file build/test/data/dfs/data/data2/current/blk_-8990161524735521721
2013-10-31 16:21:02,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1039536471123630660_1418 file build/test/data/dfs/data/data1/current/blk_1039536471123630660 for deletion
2013-10-31 16:21:02,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5817354174245219485_1416 at file build/test/data/dfs/data/data1/current/blk_-5817354174245219485
2013-10-31 16:21:02,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3223268501587367091_1417 file build/test/data/dfs/data/data2/current/blk_3223268501587367091 for deletion
2013-10-31 16:21:02,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1039536471123630660_1418 at file build/test/data/dfs/data/data1/current/blk_1039536471123630660
2013-10-31 16:21:02,951 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3223268501587367091_1417 at file build/test/data/dfs/data/data2/current/blk_3223268501587367091
2013-10-31 16:21:03,374 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_3223268501587367091_1417 blk_1039536471123630660_1418 blk_-5817354174245219485_1416
2013-10-31 16:21:03,374 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_3223268501587367091_1417 blk_-5817354174245219485_1416 blk_-8990161524735521721_1419
2013-10-31 16:21:03,549 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5817354174245219485_1416 file build/test/data/dfs/data/data4/current/blk_-5817354174245219485 for deletion
2013-10-31 16:21:03,549 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1039536471123630660_1418 file build/test/data/dfs/data/data4/current/blk_1039536471123630660 for deletion
2013-10-31 16:21:03,549 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5817354174245219485_1416 at file build/test/data/dfs/data/data4/current/blk_-5817354174245219485
2013-10-31 16:21:03,549 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3223268501587367091_1417 file build/test/data/dfs/data/data3/current/blk_3223268501587367091 for deletion
2013-10-31 16:21:03,550 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1039536471123630660_1418 at file build/test/data/dfs/data/data4/current/blk_1039536471123630660
2013-10-31 16:21:03,550 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3223268501587367091_1417 at file build/test/data/dfs/data/data3/current/blk_3223268501587367091
2013-10-31 16:21:04,174 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000005_0' has completed task_20131031160444934_0036_m_000005 successfully.
2013-10-31 16:21:04,175 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0036 has completed successfully.
2013-10-31 16:21:04,176 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0036,submitTime=1383236441121,launchTime=1383236442110,firstMapTaskLaunchTime=1383236449143,firstJobSetupTaskLaunchTime=1383236443125,firstJobCleanupTaskLaunchTime=1383236458163,finishTime=1383236464175,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E25DC1296648469AAAAE728C5F53A98B/BC1A1F8F3C3541DC8ADBFCA776760CA3] lhs/(1/1) ...edpipesplatform/samepipe3
2013-10-31 16:21:04,181 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC. blk_3626534413391577934_1428
2013-10-31 16:21:04,183 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3626534413391577934_1428 src: /127.0.0.1:56942 dest: /127.0.0.1:41648
2013-10-31 16:21:05,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3626534413391577934_1428 src: /127.0.0.1:36838 dest: /127.0.0.1:50942
2013-10-31 16:21:05,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3626534413391577934_1428 src: /127.0.0.1:36908 dest: /127.0.0.1:38271
2013-10-31 16:21:05,260 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36908, dest: /127.0.0.1:38271, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3626534413391577934_1428, duration: 5363722
2013-10-31 16:21:05,261 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3626534413391577934_1428 terminating
2013-10-31 16:21:05,261 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36838, dest: /127.0.0.1:50942, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3626534413391577934_1428, duration: 4884294
2013-10-31 16:21:05,262 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3626534413391577934_1428 terminating
2013-10-31 16:21:05,262 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56942, dest: /127.0.0.1:41648, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3626534413391577934_1428, duration: 7237958
2013-10-31 16:21:05,263 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3626534413391577934_1428 terminating
2013-10-31 16:21:05,267 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3626534413391577934_1428 size 26329
2013-10-31 16:21:05,267 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC from client DFSClient_-1735618845
2013-10-31 16:21:05,268 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC is closed by DFSClient_-1735618845
2013-10-31 16:21:05,268 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2286 Total time for transactions(ms): 49Number of transactions batched in Syncs: 256 Number of syncs: 1639 SyncTimes(ms): 78307 16103 
2013-10-31 16:21:05,268 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3626534413391577934_1428 size 26329
2013-10-31 16:21:05,269 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3626534413391577934_1428 size 26329
2013-10-31 16:21:05,482 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:21:05,485 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000000_0'
2013-10-31 16:21:05,486 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000001_0'
2013-10-31 16:21:05,486 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000005_0'
2013-10-31 16:21:05,487 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8553465570091622260 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:05,487 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000006_0'
2013-10-31 16:21:05,488 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8553465570091622260 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:05,488 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0036_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:21:05,488 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8553465570091622260 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:05,488 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000004_0'
2013-10-31 16:21:05,490 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000002_0'
2013-10-31 16:21:05,490 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0036
2013-10-31 16:21:05,490 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000003_0'
2013-10-31 16:21:05,490 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0036 being deleted.
2013-10-31 16:21:05,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036	dst=null	perm=null
2013-10-31 16:21:05,497 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary
2013-10-31 16:21:05,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2013-10-31 16:21:05,517 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:21:05,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2013-10-31 16:21:05,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2013-10-31 16:21:05,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2013-10-31 16:21:05,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2013-10-31 16:21:05,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2013-10-31 16:21:05,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2013-10-31 16:21:05,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36841, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1303671696596010570_1423, duration: 347250
2013-10-31 16:21:05,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2013-10-31 16:21:05,530 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56947, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8735242422086387614_1424, duration: 257113
2013-10-31 16:21:05,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2013-10-31 16:21:05,533 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56948, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3563163408596565662_1426, duration: 291853
2013-10-31 16:21:05,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2013-10-31 16:21:05,536 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49946, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6798991363969057773_1426, duration: 252081
2013-10-31 16:21:05,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2013-10-31 16:21:05,539 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49947, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-115642158726394487_1427, duration: 248103
2013-10-31 16:21:05,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2013-10-31 16:21:05,557 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:21:05,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2013-10-31 16:21:05,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2013-10-31 16:21:05,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2013-10-31 16:21:05,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2013-10-31 16:21:05,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2013-10-31 16:21:05,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2013-10-31 16:21:05,566 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49948, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1303671696596010570_1423, duration: 269850
2013-10-31 16:21:05,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2013-10-31 16:21:05,569 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56952, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8735242422086387614_1424, duration: 256256
2013-10-31 16:21:05,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2013-10-31 16:21:05,572 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36917, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3563163408596565662_1426, duration: 256740
2013-10-31 16:21:05,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2013-10-31 16:21:05,575 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56954, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6798991363969057773_1426, duration: 250081
2013-10-31 16:21:05,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2013-10-31 16:21:05,578 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36919, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-115642158726394487_1427, duration: 250943
2013-10-31 16:21:05,578 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/samepipe3
2013-10-31 16:21:05,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2013-10-31 16:21:05,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2013-10-31 16:21:05,587 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56956, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1303671696596010570_1423, duration: 347935
2013-10-31 16:21:05,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2013-10-31 16:21:05,591 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36852, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8735242422086387614_1424, duration: 256710
2013-10-31 16:21:05,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2013-10-31 16:21:05,595 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36922, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3563163408596565662_1426, duration: 245498
2013-10-31 16:21:05,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2013-10-31 16:21:05,599 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56959, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6798991363969057773_1426, duration: 244063
2013-10-31 16:21:05,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2013-10-31 16:21:05,603 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36924, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-115642158726394487_1427, duration: 244750
2013-10-31 16:21:05,623 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:21:05,624 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:21:05,638 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:21:05,638 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:21:05,639 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:21:05,639 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby"]
2013-10-31 16:21:05,639 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:21:05,639 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:21:05,640 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:21:05,640 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...pipesplatform/joingroupby
2013-10-31 16:21:05,643 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:21:05,643 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:21:05,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:05,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:21:05,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,669 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar. blk_-6908714528030553586_1429
2013-10-31 16:21:05,671 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6908714528030553586_1429 src: /127.0.0.1:49958 dest: /127.0.0.1:47311
2013-10-31 16:21:05,672 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6908714528030553586_1429 src: /127.0.0.1:56962 dest: /127.0.0.1:41648
2013-10-31 16:21:05,674 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6908714528030553586_1429 src: /127.0.0.1:36927 dest: /127.0.0.1:38271
2013-10-31 16:21:05,682 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36927, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6908714528030553586_1429, duration: 4155304
2013-10-31 16:21:05,682 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6908714528030553586_1429 terminating
2013-10-31 16:21:05,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56962, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6908714528030553586_1429, duration: 5465303
2013-10-31 16:21:05,683 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6908714528030553586_1429 terminating
2013-10-31 16:21:05,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49958, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6908714528030553586_1429, duration: 5992070
2013-10-31 16:21:05,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6908714528030553586_1429 terminating
2013-10-31 16:21:05,686 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6908714528030553586_1429 size 238055
2013-10-31 16:21:05,686 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar from client DFSClient_1457307213
2013-10-31 16:21:05,687 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar is closed by DFSClient_1457307213
2013-10-31 16:21:05,688 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6908714528030553586_1429 size 238055
2013-10-31 16:21:05,688 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6908714528030553586_1429 size 238055
2013-10-31 16:21:05,695 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar. New replication is 10
2013-10-31 16:21:05,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar	dst=null	perm=null
2013-10-31 16:21:05,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,710 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:21:05,712 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:21:05,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:05,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,731 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split. New replication is 10
2013-10-31 16:21:05,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split	dst=null	perm=null
2013-10-31 16:21:05,740 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split. blk_-2094827360920713963_1430
2013-10-31 16:21:05,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2094827360920713963_1430 src: /127.0.0.1:49961 dest: /127.0.0.1:47311
2013-10-31 16:21:05,743 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2094827360920713963_1430 src: /127.0.0.1:36929 dest: /127.0.0.1:38271
2013-10-31 16:21:05,744 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2094827360920713963_1430 src: /127.0.0.1:56966 dest: /127.0.0.1:41648
2013-10-31 16:21:05,746 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2094827360920713963_1430 src: /127.0.0.1:36862 dest: /127.0.0.1:50942
2013-10-31 16:21:05,749 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36862, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2094827360920713963_1430, duration: 1655787
2013-10-31 16:21:05,750 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2094827360920713963_1430 terminating
2013-10-31 16:21:05,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56966, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2094827360920713963_1430, duration: 1073454
2013-10-31 16:21:05,751 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2094827360920713963_1430 terminating
2013-10-31 16:21:05,751 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2094827360920713963_1430 size 1732
2013-10-31 16:21:05,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36929, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2094827360920713963_1430, duration: 1954010
2013-10-31 16:21:05,751 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2094827360920713963_1430 terminating
2013-10-31 16:21:05,752 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49961, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2094827360920713963_1430, duration: 2795667
2013-10-31 16:21:05,752 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2094827360920713963_1430 size 1732
2013-10-31 16:21:05,752 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2094827360920713963_1430 terminating
2013-10-31 16:21:05,755 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2094827360920713963_1430 size 1732
2013-10-31 16:21:05,755 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2094827360920713963_1430 size 1732
2013-10-31 16:21:05,756 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split from client DFSClient_1457307213
2013-10-31 16:21:05,756 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split is closed by DFSClient_1457307213
2013-10-31 16:21:05,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,779 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo. blk_1425349623274254743_1431
2013-10-31 16:21:05,780 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1425349623274254743_1431 src: /127.0.0.1:56968 dest: /127.0.0.1:41648
2013-10-31 16:21:05,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1425349623274254743_1431 src: /127.0.0.1:36864 dest: /127.0.0.1:50942
2013-10-31 16:21:05,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1425349623274254743_1431 src: /127.0.0.1:49967 dest: /127.0.0.1:47311
2013-10-31 16:21:05,786 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49967, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1425349623274254743_1431, duration: 64252
2013-10-31 16:21:05,787 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1425349623274254743_1431 terminating
2013-10-31 16:21:05,787 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1425349623274254743_1431 size 183
2013-10-31 16:21:05,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36864, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1425349623274254743_1431, duration: 923015
2013-10-31 16:21:05,788 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1425349623274254743_1431 terminating
2013-10-31 16:21:05,788 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56968, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1425349623274254743_1431, duration: 1781479
2013-10-31 16:21:05,789 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1425349623274254743_1431 size 183
2013-10-31 16:21:05,789 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1425349623274254743_1431 terminating
2013-10-31 16:21:05,791 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:21:05,791 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:21:05,793 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1425349623274254743_1431 size 183
2013-10-31 16:21:05,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,821 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml. blk_2882572055122643041_1432
2013-10-31 16:21:05,823 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2882572055122643041_1432 src: /127.0.0.1:49968 dest: /127.0.0.1:47311
2013-10-31 16:21:05,825 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2882572055122643041_1432 src: /127.0.0.1:36867 dest: /127.0.0.1:50942
2013-10-31 16:21:05,826 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2882572055122643041_1432 src: /127.0.0.1:56973 dest: /127.0.0.1:41648
2013-10-31 16:21:05,829 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56973, dest: /127.0.0.1:41648, bytes: 28654, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2882572055122643041_1432, duration: 165018
2013-10-31 16:21:05,829 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2882572055122643041_1432 terminating
2013-10-31 16:21:05,830 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36867, dest: /127.0.0.1:50942, bytes: 28654, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2882572055122643041_1432, duration: 954399
2013-10-31 16:21:05,830 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2882572055122643041_1432 terminating
2013-10-31 16:21:05,830 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2882572055122643041_1432 size 28654
2013-10-31 16:21:05,831 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49968, dest: /127.0.0.1:47311, bytes: 28654, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2882572055122643041_1432, duration: 1740240
2013-10-31 16:21:05,831 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2882572055122643041_1432 size 28654
2013-10-31 16:21:05,831 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2882572055122643041_1432 terminating
2013-10-31 16:21:05,834 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2882572055122643041_1432 size 28654
2013-10-31 16:21:05,835 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml from client DFSClient_1457307213
2013-10-31 16:21:05,835 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml is closed by DFSClient_1457307213
2013-10-31 16:21:06,160 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8990161524735521721_1419 file build/test/data/dfs/data/data7/current/blk_-8990161524735521721 for deletion
2013-10-31 16:21:06,160 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5817354174245219485_1416 file build/test/data/dfs/data/data7/current/blk_-5817354174245219485 for deletion
2013-10-31 16:21:06,160 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8990161524735521721_1419 at file build/test/data/dfs/data/data7/current/blk_-8990161524735521721
2013-10-31 16:21:06,160 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3223268501587367091_1417 file build/test/data/dfs/data/data8/current/blk_3223268501587367091 for deletion
2013-10-31 16:21:06,161 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5817354174245219485_1416 at file build/test/data/dfs/data/data7/current/blk_-5817354174245219485
2013-10-31 16:21:06,161 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3223268501587367091_1417 at file build/test/data/dfs/data/data8/current/blk_3223268501587367091
2013-10-31 16:21:06,375 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-6908714528030553586_1429 to datanode(s) 127.0.0.1:50942
2013-10-31 16:21:06,376 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-8553465570091622260_1422
2013-10-31 16:21:06,376 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-8553465570091622260_1422
2013-10-31 16:21:06,550 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-6908714528030553586_1429 to 127.0.0.1:50942 
2013-10-31 16:21:06,550 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8553465570091622260_1422 file build/test/data/dfs/data/data3/current/blk_-8553465570091622260 for deletion
2013-10-31 16:21:06,551 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8553465570091622260_1422 at file build/test/data/dfs/data/data3/current/blk_-8553465570091622260
2013-10-31 16:21:06,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6908714528030553586_1429 src: /127.0.0.1:36869 dest: /127.0.0.1:50942
2013-10-31 16:21:06,552 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-6908714528030553586_1429 to /127.0.0.1:50942
2013-10-31 16:21:06,555 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-6908714528030553586_1429 src: /127.0.0.1:36869 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:21:06,556 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6908714528030553586_1429 size 238055
2013-10-31 16:21:06,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml	dst=null	perm=null
2013-10-31 16:21:06,967 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56976, bytes: 28878, op: HDFS_READ, cliID: DFSClient_385456919, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2882572055122643041_1432, duration: 381929
2013-10-31 16:21:06,986 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0037: nMaps=5 nReduces=1 max=-1
2013-10-31 16:21:06,987 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0037 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:21:06,987 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0037
2013-10-31 16:21:06,987 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0037
2013-10-31 16:21:06,987 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0037	RESULT=SUCCESS
2013-10-31 16:21:06,988 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0037
2013-10-31 16:21:06,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:07,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:07,015 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_conf.xml. blk_-2516906943335505181_1434
2013-10-31 16:21:07,017 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2516906943335505181_1434 src: /127.0.0.1:49974 dest: /127.0.0.1:47311
2013-10-31 16:21:07,019 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2516906943335505181_1434 src: /127.0.0.1:36873 dest: /127.0.0.1:50942
2013-10-31 16:21:07,020 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2516906943335505181_1434 src: /127.0.0.1:36943 dest: /127.0.0.1:38271
2013-10-31 16:21:07,024 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36943, dest: /127.0.0.1:38271, bytes: 28719, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2516906943335505181_1434, duration: 491978
2013-10-31 16:21:07,025 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2516906943335505181_1434 terminating
2013-10-31 16:21:07,025 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36873, dest: /127.0.0.1:50942, bytes: 28719, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2516906943335505181_1434, duration: 1271095
2013-10-31 16:21:07,026 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2516906943335505181_1434 terminating
2013-10-31 16:21:07,026 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2516906943335505181_1434 size 28719
2013-10-31 16:21:07,026 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49974, dest: /127.0.0.1:47311, bytes: 28719, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2516906943335505181_1434, duration: 2180225
2013-10-31 16:21:07,027 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2516906943335505181_1434 terminating
2013-10-31 16:21:07,029 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_conf.xml from client DFSClient_385456919
2013-10-31 16:21:07,029 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_conf.xml is closed by DFSClient_385456919
2013-10-31 16:21:07,029 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2516906943335505181_1434 size 28719
2013-10-31 16:21:07,031 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2516906943335505181_1434 size 28719
2013-10-31 16:21:07,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:07,049 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken. blk_-5455871274990294667_1435
2013-10-31 16:21:07,051 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5455871274990294667_1435 src: /127.0.0.1:56980 dest: /127.0.0.1:41648
2013-10-31 16:21:07,053 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5455871274990294667_1435 src: /127.0.0.1:36876 dest: /127.0.0.1:50942
2013-10-31 16:21:07,054 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5455871274990294667_1435 src: /127.0.0.1:36946 dest: /127.0.0.1:38271
2013-10-31 16:21:07,059 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36946, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5455871274990294667_1435, duration: 65721
2013-10-31 16:21:07,059 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5455871274990294667_1435 terminating
2013-10-31 16:21:07,060 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36876, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5455871274990294667_1435, duration: 2896803
2013-10-31 16:21:07,060 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5455871274990294667_1435 terminating
2013-10-31 16:21:07,061 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56980, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5455871274990294667_1435, duration: 3771298
2013-10-31 16:21:07,061 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5455871274990294667_1435 terminating
2013-10-31 16:21:07,061 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5455871274990294667_1435 size 116
2013-10-31 16:21:07,063 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken from client DFSClient_1457307213
2013-10-31 16:21:07,063 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken is closed by DFSClient_1457307213
2013-10-31 16:21:07,064 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5455871274990294667_1435 size 116
2013-10-31 16:21:07,064 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5455871274990294667_1435 size 116
2013-10-31 16:21:07,071 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken
2013-10-31 16:21:07,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:21:07,075 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49980, bytes: 187, op: HDFS_READ, cliID: DFSClient_385456919, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1425349623274254743_1431, duration: 257712
2013-10-31 16:21:07,077 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0037 = 19. Number of splits = 5
2013-10-31 16:21:07,077 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,077 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,078 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,078 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,078 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,078 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,080 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,080 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,080 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,080 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,081 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0037 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:21:07,081 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0037 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:21:07,166 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8553465570091622260_1422 file build/test/data/dfs/data/data6/current/blk_-8553465570091622260 for deletion
2013-10-31 16:21:07,167 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8553465570091622260_1422 at file build/test/data/dfs/data/data6/current/blk_-8553465570091622260
2013-10-31 16:21:08,493 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0037_m_000006_0' to tip task_20131031160444934_0037_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:08,501 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:21:08,501 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000006_0 which needs 1 slots
2013-10-31 16:21:08,502 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000006_0 which needs 1 slots
2013-10-31 16:21:08,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken	dst=null	perm=null
2013-10-31 16:21:08,510 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56984, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5455871274990294667_1435, duration: 297502
2013-10-31 16:21:08,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml	dst=null	perm=null
2013-10-31 16:21:08,524 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49983, bytes: 28878, op: HDFS_READ, cliID: DFSClient_-73383415, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2882572055122643041_1432, duration: 373121
2013-10-31 16:21:08,554 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:08,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar	dst=null	perm=null
2013-10-31 16:21:08,582 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36882, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-73383415, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6908714528030553586_1429, duration: 1180756
2013-10-31 16:21:08,689 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0036_m_-1410338411
2013-10-31 16:21:08,698 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group428 with signal TERM. Exit code 0
2013-10-31 16:21:08,698 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_-719453515
2013-10-31 16:21:08,699 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_-719453515 spawned.
2013-10-31 16:21:08,702 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000006_0/taskjvm.sh
2013-10-31 16:21:09,113 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0036_m_-1410338411
2013-10-31 16:21:09,377 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-8553465570091622260_1422
2013-10-31 16:21:09,463 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:09,463 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:09,463 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:09,463 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_-1410338411 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:10,119 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_-719453515 given task: attempt_20131031160444934_0037_m_000006_0
2013-10-31 16:21:10,489 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0036
2013-10-31 16:21:10,489 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000000_0 not found in cache
2013-10-31 16:21:10,489 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000001_0 not found in cache
2013-10-31 16:21:10,489 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000005_0 not found in cache
2013-10-31 16:21:10,489 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0036 for user-log deletion with retainTimeStamp:1383322870489
2013-10-31 16:21:10,489 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0036
2013-10-31 16:21:10,490 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000004_0 not found in cache
2013-10-31 16:21:10,490 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0036 for user-log deletion with retainTimeStamp:1383322870490
2013-10-31 16:21:10,491 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0036
2013-10-31 16:21:10,491 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000003_0 not found in cache
2013-10-31 16:21:10,491 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000002_0 not found in cache
2013-10-31 16:21:10,491 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0036 for user-log deletion with retainTimeStamp:1383322870491
2013-10-31 16:21:10,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:11,022 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0036_m_764575079 since job job_20131031160444934_0036 is dead
2013-10-31 16:21:11,030 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group496 with signal TERM. Exit code 0
2013-10-31 16:21:11,031 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0036_m_986697684 since job job_20131031160444934_0036 is dead
2013-10-31 16:21:11,038 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group499 with signal TERM. Exit code 0
2013-10-31 16:21:11,217 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:11,217 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:11,217 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:11,218 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_764575079 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:11,218 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:11,218 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:11,218 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:11,219 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_986697684 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:11,461 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0036_m_-1374678209 since job job_20131031160444934_0036 is dead
2013-10-31 16:21:11,470 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32726 with signal TERM. Exit code 0
2013-10-31 16:21:11,644 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:11,644 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:11,644 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:11,645 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_-1374678209 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:21:11,737 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0036_m_-2008477174 since job job_20131031160444934_0036 is dead
2013-10-31 16:21:11,747 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group590 with signal TERM. Exit code 0
2013-10-31 16:21:11,952 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8553465570091622260_1422 file build/test/data/dfs/data/data2/current/blk_-8553465570091622260 for deletion
2013-10-31 16:21:11,952 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8553465570091622260_1422 at file build/test/data/dfs/data/data2/current/blk_-8553465570091622260
2013-10-31 16:21:11,961 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:11,961 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:11,961 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:11,961 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_-2008477174 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:13,538 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000006_0 0.0% setup
2013-10-31 16:21:13,540 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000006_0 is done.
2013-10-31 16:21:13,541 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000006_0  was -1
2013-10-31 16:21:13,541 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:14,508 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000006_0' has completed task_20131031160444934_0037_m_000006 successfully.
2013-10-31 16:21:14,649 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000000_0' to tip task_20131031160444934_0037_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:14,651 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000000
2013-10-31 16:21:14,651 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000001_0' to tip task_20131031160444934_0037_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:14,652 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000001
2013-10-31 16:21:14,653 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000002_0' to tip task_20131031160444934_0037_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:21:14,653 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000002
2013-10-31 16:21:14,654 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:21:14,654 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000003_0' to tip task_20131031160444934_0037_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:21:14,655 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:21:14,655 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000000_0 which needs 1 slots
2013-10-31 16:21:14,655 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000003
2013-10-31 16:21:14,655 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000000_0 which needs 1 slots
2013-10-31 16:21:14,656 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000001_0 which needs 1 slots
2013-10-31 16:21:14,656 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0037_m_000001_0 which needs 1 slots
2013-10-31 16:21:14,656 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000004_0' to tip task_20131031160444934_0037_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:21:14,657 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000004
2013-10-31 16:21:14,692 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:21:14,692 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:21:14,693 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:21:14,693 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000004_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000002_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000004_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000002_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000003_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0037_m_000003_0 which needs 1 slots
2013-10-31 16:21:14,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken	dst=null	perm=null
2013-10-31 16:21:14,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken	dst=null	perm=null
2013-10-31 16:21:14,795 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_170743000
2013-10-31 16:21:14,796 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_170743000 spawned.
2013-10-31 16:21:14,798 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0037/attempt_20131031160444934_0037_m_000001_0. Attempting to reuse: jvm_20131031160444934_0037_m_-719453515
2013-10-31 16:21:14,799 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36885, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5455871274990294667_1435, duration: 2464547
2013-10-31 16:21:14,800 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56991, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5455871274990294667_1435, duration: 382159
2013-10-31 16:21:14,801 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000000_0/taskjvm.sh
2013-10-31 16:21:14,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml	dst=null	perm=null
2013-10-31 16:21:14,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml	dst=null	perm=null
2013-10-31 16:21:14,811 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36889, bytes: 28878, op: HDFS_READ, cliID: DFSClient_-2062392550, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2882572055122643041_1432, duration: 399151
2013-10-31 16:21:14,812 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36890, bytes: 28878, op: HDFS_READ, cliID: DFSClient_-1210340384, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2882572055122643041_1432, duration: 397216
2013-10-31 16:21:14,835 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:14,835 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:14,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar	dst=null	perm=null
2013-10-31 16:21:14,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar	dst=null	perm=null
2013-10-31 16:21:14,861 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36960, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2062392550, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6908714528030553586_1429, duration: 853533
2013-10-31 16:21:14,864 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36892, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1210340384, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6908714528030553586_1429, duration: 1664090
2013-10-31 16:21:14,918 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_2019793849
2013-10-31 16:21:14,919 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_2019793849 spawned.
2013-10-31 16:21:14,919 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_-2116369040
2013-10-31 16:21:14,921 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_-2116369040 spawned.
2013-10-31 16:21:14,921 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000003_0/taskjvm.sh
2013-10-31 16:21:14,922 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000002_0/taskjvm.sh
2013-10-31 16:21:14,934 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_1747797240
2013-10-31 16:21:14,935 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_1747797240 spawned.
2013-10-31 16:21:14,936 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000004_0/taskjvm.sh
2013-10-31 16:21:15,100 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_-719453515 given task: attempt_20131031160444934_0037_m_000001_0
2013-10-31 16:21:15,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split	dst=null	perm=null
2013-10-31 16:21:15,220 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56999, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2094827360920713963_1430, duration: 171615
2013-10-31 16:21:15,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:15,262 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36964, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 113723
2013-10-31 16:21:15,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:15,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:15,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36897, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 131561
2013-10-31 16:21:15,719 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_170743000 given task: attempt_20131031160444934_0037_m_000000_0
2013-10-31 16:21:16,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split	dst=null	perm=null
2013-10-31 16:21:16,216 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57004, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2094827360920713963_1430, duration: 168798
2013-10-31 16:21:16,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:16,521 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_2019793849 given task: attempt_20131031160444934_0037_m_000003_0
2013-10-31 16:21:16,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:16,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:16,532 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57008, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 128559
2013-10-31 16:21:16,535 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50006, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 99441
2013-10-31 16:21:16,550 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_1747797240 given task: attempt_20131031160444934_0037_m_000004_0
2013-10-31 16:21:16,550 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_-2116369040 given task: attempt_20131031160444934_0037_m_000002_0
2013-10-31 16:21:17,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split	dst=null	perm=null
2013-10-31 16:21:17,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split	dst=null	perm=null
2013-10-31 16:21:17,045 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36908, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2094827360920713963_1430, duration: 245849
2013-10-31 16:21:17,047 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36978, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2094827360920713963_1430, duration: 143073
2013-10-31 16:21:17,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split	dst=null	perm=null
2013-10-31 16:21:17,061 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57015, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2094827360920713963_1430, duration: 143428
2013-10-31 16:21:17,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:17,084 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50013, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 104609
2013-10-31 16:21:17,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:17,087 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36912, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 158969
2013-10-31 16:21:17,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:17,102 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50015, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 146765
2013-10-31 16:21:17,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:17,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:17,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:17,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:17,364 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36914, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 1309250
2013-10-31 16:21:17,365 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50017, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 152386
2013-10-31 16:21:17,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:17,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:21:17,379 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36916, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 107711
2013-10-31 16:21:18,169 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:21:18,171 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000001_0 is done.
2013-10-31 16:21:18,172 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000001_0  was 35
2013-10-31 16:21:18,172 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:21:19,145 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:21:19,148 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000000_0 is done.
2013-10-31 16:21:19,148 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000000_0  was 35
2013-10-31 16:21:19,149 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:19,655 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0037_m_000006_0
2013-10-31 16:21:19,656 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0037_m_000006_0
2013-10-31 16:21:19,656 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0037_m_000006_0 not found in cache
2013-10-31 16:21:19,970 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:21:19,973 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:21:19,974 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000003_0 is done.
2013-10-31 16:21:19,974 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000003_0  was 35
2013-10-31 16:21:19,974 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:21:19,975 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000002_0 is done.
2013-10-31 16:21:19,975 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000002_0  was 35
2013-10-31 16:21:19,976 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:19,988 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:21:19,990 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000004_0 is done.
2013-10-31 16:21:19,990 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000004_0  was 35
2013-10-31 16:21:19,990 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:20,660 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000000_0' has completed task_20131031160444934_0037_m_000000 successfully.
2013-10-31 16:21:20,662 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000001_0' has completed task_20131031160444934_0037_m_000001 successfully.
2013-10-31 16:21:20,664 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0037_r_000000_0' to tip task_20131031160444934_0037_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:20,666 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:21:20,667 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_r_000000_0 which needs 1 slots
2013-10-31 16:21:20,667 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_r_000000_0 which needs 1 slots
2013-10-31 16:21:20,695 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_r_206848199
2013-10-31 16:21:20,696 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_r_206848199 spawned.
2013-10-31 16:21:20,697 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000002_0' has completed task_20131031160444934_0037_m_000002 successfully.
2013-10-31 16:21:20,698 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_r_000000_0/taskjvm.sh
2013-10-31 16:21:20,943 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000003_0' has completed task_20131031160444934_0037_m_000003 successfully.
2013-10-31 16:21:20,944 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000004_0' has completed task_20131031160444934_0037_m_000004 successfully.
2013-10-31 16:21:21,761 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_r_206848199 given task: attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:27,465 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60644, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000000_0, duration: 9239217
2013-10-31 16:21:27,489 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60644, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000001_0, duration: 10631582
2013-10-31 16:21:27,506 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:49520, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000002_0, duration: 12642289
2013-10-31 16:21:27,522 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:49520, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000003_0, duration: 11521265
2013-10-31 16:21:27,539 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:48714, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000004_0, duration: 12371906
2013-10-31 16:21:28,259 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:21:28,319 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:21:28,380 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:21:28,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:28,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:28,614 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000. blk_-4902470675330313153_1436
2013-10-31 16:21:28,639 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4902470675330313153_1436 src: /127.0.0.1:50024 dest: /127.0.0.1:47311
2013-10-31 16:21:28,640 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4902470675330313153_1436 src: /127.0.0.1:57028 dest: /127.0.0.1:41648
2013-10-31 16:21:28,641 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4902470675330313153_1436 src: /127.0.0.1:36993 dest: /127.0.0.1:38271
2013-10-31 16:21:28,645 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36993, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0037_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4902470675330313153_1436, duration: 1397776
2013-10-31 16:21:28,645 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4902470675330313153_1436 terminating
2013-10-31 16:21:28,648 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4902470675330313153_1436 size 40
2013-10-31 16:21:28,649 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57028, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0037_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4902470675330313153_1436, duration: 2839670
2013-10-31 16:21:28,650 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4902470675330313153_1436 size 40
2013-10-31 16:21:28,650 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4902470675330313153_1436 terminating
2013-10-31 16:21:28,650 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50024, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0037_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4902470675330313153_1436, duration: 7481263
2013-10-31 16:21:28,650 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4902470675330313153_1436 terminating
2013-10-31 16:21:28,652 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:28,653 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:28,654 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4902470675330313153_1436 size 40
2013-10-31 16:21:28,694 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0037_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:28,694 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:21:29,675 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031160444934_0037_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:43831
2013-10-31 16:21:29,676 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:29,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0	dst=null	perm=null
2013-10-31 16:21:29,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:29,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:29,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0	dst=null	perm=null
2013-10-31 16:21:31,308 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 1.0% reduce > reduce
2013-10-31 16:21:31,310 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 1.0% reduce > reduce
2013-10-31 16:21:31,311 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_r_000000_0 is done.
2013-10-31 16:21:31,311 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_r_000000_0  was -1
2013-10-31 16:21:31,311 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:32,680 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_r_000000_0' has completed task_20131031160444934_0037_r_000000 successfully.
2013-10-31 16:21:32,683 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0037_m_000005_0' to tip task_20131031160444934_0037_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:32,685 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:21:32,685 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000005_0 which needs 1 slots
2013-10-31 16:21:32,686 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000005_0 which needs 1 slots
2013-10-31 16:21:32,800 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0037/attempt_20131031160444934_0037_m_000005_0. Attempting to reuse: jvm_20131031160444934_0037_m_170743000
2013-10-31 16:21:33,217 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_170743000 given task: attempt_20131031160444934_0037_m_000005_0
2013-10-31 16:21:33,350 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000005_0 0.0% 
2013-10-31 16:21:33,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary	dst=null	perm=null
2013-10-31 16:21:33,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:33,375 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_SUCCESS from client DFSClient_attempt_20131031160444934_0037_m_000005_0
2013-10-31 16:21:33,376 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0037_m_000005_0
2013-10-31 16:21:33,553 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6908714528030553586 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:33,553 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6908714528030553586 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:33,554 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6908714528030553586 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:33,554 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6908714528030553586 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:33,554 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2094827360920713963 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:33,554 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2094827360920713963 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:33,555 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2094827360920713963 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:33,555 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2094827360920713963 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:33,555 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1425349623274254743 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:33,555 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1425349623274254743 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:33,555 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1425349623274254743 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:33,556 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2882572055122643041 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:33,556 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2882572055122643041 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:33,556 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2882572055122643041 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:33,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037	dst=null	perm=null
2013-10-31 16:21:36,324 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000005_0 0.0% cleanup
2013-10-31 16:21:36,325 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000005_0 is done.
2013-10-31 16:21:36,326 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000005_0  was -1
2013-10-31 16:21:36,326 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:36,381 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-6908714528030553586_1429 blk_-2094827360920713963_1430
2013-10-31 16:21:36,381 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_1425349623274254743_1431 blk_-6908714528030553586_1429 blk_2882572055122643041_1432 blk_-2094827360920713963_1430
2013-10-31 16:21:36,560 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6908714528030553586_1429 file build/test/data/dfs/data/data3/current/blk_-6908714528030553586 for deletion
2013-10-31 16:21:36,560 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2094827360920713963_1430 file build/test/data/dfs/data/data4/current/blk_-2094827360920713963 for deletion
2013-10-31 16:21:36,560 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6908714528030553586_1429 at file build/test/data/dfs/data/data3/current/blk_-6908714528030553586
2013-10-31 16:21:36,560 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2094827360920713963_1430 at file build/test/data/dfs/data/data4/current/blk_-2094827360920713963
2013-10-31 16:21:36,560 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1425349623274254743_1431 file build/test/data/dfs/data/data3/current/blk_1425349623274254743 for deletion
2013-10-31 16:21:36,561 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2882572055122643041_1432 file build/test/data/dfs/data/data4/current/blk_2882572055122643041 for deletion
2013-10-31 16:21:36,561 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1425349623274254743_1431 at file build/test/data/dfs/data/data3/current/blk_1425349623274254743
2013-10-31 16:21:36,562 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2882572055122643041_1432 at file build/test/data/dfs/data/data4/current/blk_2882572055122643041
2013-10-31 16:21:37,686 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:37,686 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:38,693 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000005_0' has completed task_20131031160444934_0037_m_000005 successfully.
2013-10-31 16:21:38,961 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6908714528030553586_1429 file build/test/data/dfs/data/data1/current/blk_-6908714528030553586 for deletion
2013-10-31 16:21:38,961 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2094827360920713963_1430 file build/test/data/dfs/data/data2/current/blk_-2094827360920713963 for deletion
2013-10-31 16:21:39,381 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_1425349623274254743_1431 blk_-6908714528030553586_1429 blk_2882572055122643041_1432 blk_-2094827360920713963_1430
2013-10-31 16:21:39,382 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_1425349623274254743_1431 blk_-6908714528030553586_1429 blk_2882572055122643041_1432 blk_-2094827360920713963_1430
2013-10-31 16:21:39,847 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:21:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,871 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,876 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,882 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,887 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,892 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,893 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:21:39,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2094827360920713963_1430 at file build/test/data/dfs/data/data2/current/blk_-2094827360920713963
2013-10-31 16:21:39,950 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6908714528030553586_1429 at file build/test/data/dfs/data/data1/current/blk_-6908714528030553586
2013-10-31 16:21:39,951 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0037 has completed successfully.
2013-10-31 16:21:39,951 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0037,submitTime=1383236466958,launchTime=1383236467081,firstMapTaskLaunchTime=1383236474649,firstReduceTaskLaunchTime=1383236480663,firstJobSetupTaskLaunchTime=1383236468493,firstJobCleanupTaskLaunchTime=1383236492682,finishTime=1383236499951,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[6276220B6D5C41E99CB784247E017C0C/AF7CF26E39CB4FABBFCD63E64566EF85] lower*upper/(1/1) ...pipesplatform/joingroupby
2013-10-31 16:21:39,958 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB. blk_8631568984076934450_1437
2013-10-31 16:21:39,960 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8631568984076934450_1437 src: /127.0.0.1:37000 dest: /127.0.0.1:38271
2013-10-31 16:21:39,962 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8631568984076934450_1437 src: /127.0.0.1:36932 dest: /127.0.0.1:50942
2013-10-31 16:21:39,964 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8631568984076934450_1437 src: /127.0.0.1:50035 dest: /127.0.0.1:47311
2013-10-31 16:21:39,994 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50035, dest: /127.0.0.1:47311, bytes: 31995, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8631568984076934450_1437, duration: 4006042
2013-10-31 16:21:39,994 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8631568984076934450_1437 terminating
2013-10-31 16:21:39,994 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36932, dest: /127.0.0.1:50942, bytes: 31995, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8631568984076934450_1437, duration: 27913777
2013-10-31 16:21:39,995 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8631568984076934450_1437 terminating
2013-10-31 16:21:39,995 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8631568984076934450_1437 size 31995
2013-10-31 16:21:39,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37000, dest: /127.0.0.1:38271, bytes: 31995, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8631568984076934450_1437, duration: 28858762
2013-10-31 16:21:39,996 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8631568984076934450_1437 terminating
2013-10-31 16:21:39,998 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8631568984076934450_1437 size 31995
2013-10-31 16:21:39,999 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB from client DFSClient_385456919
2013-10-31 16:21:39,999 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB is closed by DFSClient_385456919
2013-10-31 16:21:40,000 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8631568984076934450_1437 size 31995
2013-10-31 16:21:40,007 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:21:40,008 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000000_0'
2013-10-31 16:21:40,008 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000001_0'
2013-10-31 16:21:40,008 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000005_0'
2013-10-31 16:21:40,009 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000006_0'
2013-10-31 16:21:40,010 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_r_000000_0'
2013-10-31 16:21:40,010 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5455871274990294667 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:40,010 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5455871274990294667 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:40,010 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5455871274990294667 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:40,011 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000004_0'
2013-10-31 16:21:40,011 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000002_0'
2013-10-31 16:21:40,012 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000003_0'
2013-10-31 16:21:40,013 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0037_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:21:40,022 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary
2013-10-31 16:21:40,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037	dst=null	perm=null
2013-10-31 16:21:40,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2013-10-31 16:21:40,080 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:21:40,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2013-10-31 16:21:40,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2013-10-31 16:21:40,085 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50037, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4902470675330313153_1436, duration: 278697
2013-10-31 16:21:40,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2013-10-31 16:21:40,103 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:21:40,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2013-10-31 16:21:40,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2013-10-31 16:21:40,108 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37005, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4902470675330313153_1436, duration: 257239
2013-10-31 16:21:40,108 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joingroupby
2013-10-31 16:21:40,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2013-10-31 16:21:40,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2013-10-31 16:21:40,116 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37006, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4902470675330313153_1436, duration: 256300
2013-10-31 16:21:40,134 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:21:40,135 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:21:40,151 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] starting
2013-10-31 16:21:40,151 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:21:40,152 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe"]
2013-10-31 16:21:40,152 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  parallel execution is enabled: true
2013-10-31 16:21:40,152 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  starting jobs: 1
2013-10-31 16:21:40,152 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower]  allocating threads: 1
2013-10-31 16:21:40,153 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower] starting step: (1/1) ...dedpipesplatform/samepipe
2013-10-31 16:21:40,158 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:21:40,159 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:21:40,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:40,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:21:40,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6908714528030553586_1429 file build/test/data/dfs/data/data6/current/blk_-6908714528030553586 for deletion
2013-10-31 16:21:40,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2094827360920713963_1430 file build/test/data/dfs/data/data5/current/blk_-2094827360920713963 for deletion
2013-10-31 16:21:40,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6908714528030553586_1429 at file build/test/data/dfs/data/data6/current/blk_-6908714528030553586
2013-10-31 16:21:40,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2094827360920713963_1430 at file build/test/data/dfs/data/data5/current/blk_-2094827360920713963
2013-10-31 16:21:40,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1425349623274254743_1431 file build/test/data/dfs/data/data6/current/blk_1425349623274254743 for deletion
2013-10-31 16:21:40,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2882572055122643041_1432 file build/test/data/dfs/data/data5/current/blk_2882572055122643041 for deletion
2013-10-31 16:21:40,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1425349623274254743_1431 at file build/test/data/dfs/data/data6/current/blk_1425349623274254743
2013-10-31 16:21:40,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2882572055122643041_1432 at file build/test/data/dfs/data/data5/current/blk_2882572055122643041
2013-10-31 16:21:40,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,185 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar. blk_5735244170345871603_1438
2013-10-31 16:21:40,187 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5735244170345871603_1438 src: /127.0.0.1:50040 dest: /127.0.0.1:47311
2013-10-31 16:21:40,188 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5735244170345871603_1438 src: /127.0.0.1:37008 dest: /127.0.0.1:38271
2013-10-31 16:21:40,190 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5735244170345871603_1438 src: /127.0.0.1:57045 dest: /127.0.0.1:41648
2013-10-31 16:21:40,201 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57045, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5735244170345871603_1438, duration: 7267178
2013-10-31 16:21:40,201 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5735244170345871603_1438 terminating
2013-10-31 16:21:40,201 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5735244170345871603_1438 size 238055
2013-10-31 16:21:40,201 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37008, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5735244170345871603_1438, duration: 8155844
2013-10-31 16:21:40,202 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5735244170345871603_1438 size 238055
2013-10-31 16:21:40,202 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5735244170345871603_1438 terminating
2013-10-31 16:21:40,203 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50040, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5735244170345871603_1438, duration: 9274495
2013-10-31 16:21:40,203 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5735244170345871603_1438 terminating
2013-10-31 16:21:40,205 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar from client DFSClient_1457307213
2013-10-31 16:21:40,206 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar is closed by DFSClient_1457307213
2013-10-31 16:21:40,207 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5735244170345871603_1438 size 238055
2013-10-31 16:21:40,212 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar. New replication is 10
2013-10-31 16:21:40,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar	dst=null	perm=null
2013-10-31 16:21:40,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,224 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:21:40,229 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:21:40,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:40,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,244 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split. New replication is 10
2013-10-31 16:21:40,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split	dst=null	perm=null
2013-10-31 16:21:40,251 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split. blk_3057745973757760936_1439
2013-10-31 16:21:40,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3057745973757760936_1439 src: /127.0.0.1:57046 dest: /127.0.0.1:41648
2013-10-31 16:21:40,253 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3057745973757760936_1439 src: /127.0.0.1:50044 dest: /127.0.0.1:47311
2013-10-31 16:21:40,254 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3057745973757760936_1439 src: /127.0.0.1:36943 dest: /127.0.0.1:50942
2013-10-31 16:21:40,255 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3057745973757760936_1439 src: /127.0.0.1:37013 dest: /127.0.0.1:38271
2013-10-31 16:21:40,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37013, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3057745973757760936_1439, duration: 1072486
2013-10-31 16:21:40,258 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3057745973757760936_1439 terminating
2013-10-31 16:21:40,258 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36943, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3057745973757760936_1439, duration: 573567
2013-10-31 16:21:40,259 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3057745973757760936_1439 terminating
2013-10-31 16:21:40,259 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50044, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3057745973757760936_1439, duration: 1485383
2013-10-31 16:21:40,259 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3057745973757760936_1439 terminating
2013-10-31 16:21:40,259 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57046, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3057745973757760936_1439, duration: 1895063
2013-10-31 16:21:40,260 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3057745973757760936_1439 size 1732
2013-10-31 16:21:40,260 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3057745973757760936_1439 terminating
2013-10-31 16:21:40,261 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3057745973757760936_1439 size 1732
2013-10-31 16:21:40,261 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split from client DFSClient_1457307213
2013-10-31 16:21:40,262 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split is closed by DFSClient_1457307213
2013-10-31 16:21:40,262 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3057745973757760936_1439 size 1732
2013-10-31 16:21:40,262 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3057745973757760936_1439 size 1732
2013-10-31 16:21:40,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,281 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo. blk_6822661847235725823_1440
2013-10-31 16:21:40,282 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6822661847235725823_1440 src: /127.0.0.1:36945 dest: /127.0.0.1:50942
2013-10-31 16:21:40,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6822661847235725823_1440 src: /127.0.0.1:50048 dest: /127.0.0.1:47311
2013-10-31 16:21:40,285 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6822661847235725823_1440 src: /127.0.0.1:57052 dest: /127.0.0.1:41648
2013-10-31 16:21:40,287 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57052, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6822661847235725823_1440, duration: 61518
2013-10-31 16:21:40,288 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6822661847235725823_1440 size 183
2013-10-31 16:21:40,288 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6822661847235725823_1440 terminating
2013-10-31 16:21:40,288 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50048, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6822661847235725823_1440, duration: 818225
2013-10-31 16:21:40,289 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6822661847235725823_1440 size 183
2013-10-31 16:21:40,289 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6822661847235725823_1440 terminating
2013-10-31 16:21:40,289 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36945, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6822661847235725823_1440, duration: 1765698
2013-10-31 16:21:40,290 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6822661847235725823_1440 size 183
2013-10-31 16:21:40,290 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6822661847235725823_1440 terminating
2013-10-31 16:21:40,292 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:21:40,293 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:21:40,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,313 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml. blk_6236331253892733936_1441
2013-10-31 16:21:40,314 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6236331253892733936_1441 src: /127.0.0.1:57053 dest: /127.0.0.1:41648
2013-10-31 16:21:40,315 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6236331253892733936_1441 src: /127.0.0.1:37018 dest: /127.0.0.1:38271
2013-10-31 16:21:40,316 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6236331253892733936_1441 src: /127.0.0.1:36950 dest: /127.0.0.1:50942
2013-10-31 16:21:40,318 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36950, dest: /127.0.0.1:50942, bytes: 27610, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6236331253892733936_1441, duration: 1024824
2013-10-31 16:21:40,318 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6236331253892733936_1441 terminating
2013-10-31 16:21:40,318 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37018, dest: /127.0.0.1:38271, bytes: 27610, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6236331253892733936_1441, duration: 779843
2013-10-31 16:21:40,319 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6236331253892733936_1441 terminating
2013-10-31 16:21:40,319 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57053, dest: /127.0.0.1:41648, bytes: 27610, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6236331253892733936_1441, duration: 1244475
2013-10-31 16:21:40,319 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6236331253892733936_1441 size 27610
2013-10-31 16:21:40,319 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6236331253892733936_1441 terminating
2013-10-31 16:21:40,321 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6236331253892733936_1441 size 27610
2013-10-31 16:21:40,321 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml from client DFSClient_1457307213
2013-10-31 16:21:40,321 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml is closed by DFSClient_1457307213
2013-10-31 16:21:40,323 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6236331253892733936_1441 size 27610
2013-10-31 16:21:40,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml	dst=null	perm=null
2013-10-31 16:21:40,333 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37021, bytes: 27826, op: HDFS_READ, cliID: DFSClient_1423648074, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6236331253892733936_1441, duration: 165456
2013-10-31 16:21:40,350 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0038: nMaps=5 nReduces=0 max=-1
2013-10-31 16:21:40,350 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0038 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:21:40,350 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0038	RESULT=SUCCESS
2013-10-31 16:21:40,350 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0038
2013-10-31 16:21:40,350 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0038
2013-10-31 16:21:40,351 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower] submitted hadoop job: job_20131031160444934_0038
2013-10-31 16:21:41,538 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0037
2013-10-31 16:21:41,538 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0037 being deleted.
2013-10-31 16:21:42,172 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6908714528030553586_1429 file build/test/data/dfs/data/data7/current/blk_-6908714528030553586 for deletion
2013-10-31 16:21:42,172 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2094827360920713963_1430 file build/test/data/dfs/data/data8/current/blk_-2094827360920713963 for deletion
2013-10-31 16:21:42,172 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6908714528030553586_1429 at file build/test/data/dfs/data/data7/current/blk_-6908714528030553586
2013-10-31 16:21:42,172 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1425349623274254743_1431 file build/test/data/dfs/data/data7/current/blk_1425349623274254743 for deletion
2013-10-31 16:21:42,172 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2094827360920713963_1430 at file build/test/data/dfs/data/data8/current/blk_-2094827360920713963
2013-10-31 16:21:42,173 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1425349623274254743_1431 at file build/test/data/dfs/data/data7/current/blk_1425349623274254743
2013-10-31 16:21:42,173 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2882572055122643041_1432 file build/test/data/dfs/data/data8/current/blk_2882572055122643041 for deletion
2013-10-31 16:21:42,174 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2882572055122643041_1432 at file build/test/data/dfs/data/data8/current/blk_2882572055122643041
2013-10-31 16:21:42,383 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_5735244170345871603_1438 to datanode(s) 127.0.0.1:50942
2013-10-31 16:21:42,383 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-5455871274990294667_1435
2013-10-31 16:21:42,383 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-5455871274990294667_1435
2013-10-31 16:21:42,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:42,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:42,440 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_conf.xml. blk_1408456717703669255_1443
2013-10-31 16:21:42,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1408456717703669255_1443 src: /127.0.0.1:36953 dest: /127.0.0.1:50942
2013-10-31 16:21:42,444 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1408456717703669255_1443 src: /127.0.0.1:50056 dest: /127.0.0.1:47311
2013-10-31 16:21:42,446 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1408456717703669255_1443 src: /127.0.0.1:57060 dest: /127.0.0.1:41648
2013-10-31 16:21:42,450 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57060, dest: /127.0.0.1:41648, bytes: 27675, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1408456717703669255_1443, duration: 157448
2013-10-31 16:21:42,450 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1408456717703669255_1443 terminating
2013-10-31 16:21:42,451 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50056, dest: /127.0.0.1:47311, bytes: 27675, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1408456717703669255_1443, duration: 955375
2013-10-31 16:21:42,451 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1408456717703669255_1443 terminating
2013-10-31 16:21:42,452 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36953, dest: /127.0.0.1:50942, bytes: 27675, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1408456717703669255_1443, duration: 2092140
2013-10-31 16:21:42,452 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1408456717703669255_1443 terminating
2013-10-31 16:21:42,454 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1408456717703669255_1443 size 27675
2013-10-31 16:21:42,455 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_conf.xml from client DFSClient_1423648074
2013-10-31 16:21:42,455 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_conf.xml is closed by DFSClient_1423648074
2013-10-31 16:21:42,456 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1408456717703669255_1443 size 27675
2013-10-31 16:21:42,456 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1408456717703669255_1443 size 27675
2013-10-31 16:21:42,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:42,469 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken. blk_5702328025413530424_1444
2013-10-31 16:21:42,471 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5702328025413530424_1444 src: /127.0.0.1:57061 dest: /127.0.0.1:41648
2013-10-31 16:21:42,472 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5702328025413530424_1444 src: /127.0.0.1:36957 dest: /127.0.0.1:50942
2013-10-31 16:21:42,474 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5702328025413530424_1444 src: /127.0.0.1:37027 dest: /127.0.0.1:38271
2013-10-31 16:21:42,477 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37027, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5702328025413530424_1444, duration: 64698
2013-10-31 16:21:42,477 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5702328025413530424_1444 terminating
2013-10-31 16:21:42,477 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36957, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5702328025413530424_1444, duration: 870010
2013-10-31 16:21:42,478 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5702328025413530424_1444 terminating
2013-10-31 16:21:42,478 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57061, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5702328025413530424_1444, duration: 1732791
2013-10-31 16:21:42,479 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5702328025413530424_1444 terminating
2013-10-31 16:21:42,482 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5702328025413530424_1444 size 116
2013-10-31 16:21:42,482 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken from client DFSClient_1457307213
2013-10-31 16:21:42,482 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken is closed by DFSClient_1457307213
2013-10-31 16:21:42,483 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5702328025413530424_1444 size 116
2013-10-31 16:21:42,483 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5702328025413530424_1444 size 116
2013-10-31 16:21:42,488 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken
2013-10-31 16:21:42,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:21:42,492 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36959, bytes: 187, op: HDFS_READ, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6822661847235725823_1440, duration: 274117
2013-10-31 16:21:42,493 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0038 = 19. Number of splits = 5
2013-10-31 16:21:42,494 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,494 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,494 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,496 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,496 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,496 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,496 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,497 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,497 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,497 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,497 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0038 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:21:42,498 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0038 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:21:43,015 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0038_m_000006_0' to tip task_20131031160444934_0038_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:43,025 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:21:43,027 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000006_0 which needs 1 slots
2013-10-31 16:21:43,027 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000006_0 which needs 1 slots
2013-10-31 16:21:43,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken	dst=null	perm=null
2013-10-31 16:21:43,035 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36960, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5702328025413530424_1444, duration: 269489
2013-10-31 16:21:43,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml	dst=null	perm=null
2013-10-31 16:21:43,045 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37031, bytes: 27826, op: HDFS_READ, cliID: DFSClient_-1640699411, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6236331253892733936_1441, duration: 385818
2013-10-31 16:21:43,076 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:43,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar	dst=null	perm=null
2013-10-31 16:21:43,102 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37032, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1640699411, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5735244170345871603_1438, duration: 1235566
2013-10-31 16:21:43,178 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_5735244170345871603_1438 to 127.0.0.1:50942 
2013-10-31 16:21:43,180 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5735244170345871603_1438 src: /127.0.0.1:36964 dest: /127.0.0.1:50942
2013-10-31 16:21:43,180 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_5735244170345871603_1438 to /127.0.0.1:50942
2013-10-31 16:21:43,181 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5735244170345871603_1438 src: /127.0.0.1:36964 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:21:43,186 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5735244170345871603_1438 size 238055
2013-10-31 16:21:43,187 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0037_m_-719453515
2013-10-31 16:21:43,194 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group894 with signal TERM. Exit code 0
2013-10-31 16:21:43,194 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-693609248
2013-10-31 16:21:43,195 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-693609248 spawned.
2013-10-31 16:21:43,198 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000006_0/taskjvm.sh
2013-10-31 16:21:44,231 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0037_m_-719453515
2013-10-31 16:21:44,424 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:44,424 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:44,424 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:44,425 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_-719453515 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:21:44,963 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5455871274990294667_1435 file build/test/data/dfs/data/data2/current/blk_-5455871274990294667 for deletion
2013-10-31 16:21:44,963 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5455871274990294667_1435 at file build/test/data/dfs/data/data2/current/blk_-5455871274990294667
2013-10-31 16:21:45,007 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 96 raw values into 1 aggregated values, total 5
2013-10-31 16:21:45,011 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0037
2013-10-31 16:21:45,011 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0037_m_000005_0 not found in cache
2013-10-31 16:21:45,012 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0037
2013-10-31 16:21:45,012 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0037 for user-log deletion with retainTimeStamp:1383322905012
2013-10-31 16:21:45,012 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0037 for user-log deletion with retainTimeStamp:1383322905012
2013-10-31 16:21:45,013 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0037
2013-10-31 16:21:45,013 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0037 for user-log deletion with retainTimeStamp:1383322905013
2013-10-31 16:21:45,132 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-693609248 given task: attempt_20131031160444934_0038_m_000006_0
2013-10-31 16:21:45,172 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5455871274990294667_1435 file build/test/data/dfs/data/data7/current/blk_-5455871274990294667 for deletion
2013-10-31 16:21:45,173 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5455871274990294667_1435 at file build/test/data/dfs/data/data7/current/blk_-5455871274990294667
2013-10-31 16:21:45,350 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_r_206848199 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:45,355 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1330 with signal TERM. Exit code 0
2013-10-31 16:21:45,384 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-5455871274990294667_1435
2013-10-31 16:21:45,506 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:45,506 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:45,506 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:45,506 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_r_206848199 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:45,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:45,865 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_m_170743000 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:45,876 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1044 with signal TERM. Exit code 0
2013-10-31 16:21:46,047 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_m_-2116369040 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:46,052 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_m_1747797240 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:46,054 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:46,054 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:46,054 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:46,054 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_170743000 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:21:46,056 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1143 with signal TERM. Exit code 0
2013-10-31 16:21:46,057 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_m_2019793849 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:46,063 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1144 with signal TERM. Exit code 0
2013-10-31 16:21:46,086 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1112 with signal TERM. Exit code 0
2013-10-31 16:21:46,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5455871274990294667_1435 file build/test/data/dfs/data/data6/current/blk_-5455871274990294667 for deletion
2013-10-31 16:21:46,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5455871274990294667_1435 at file build/test/data/dfs/data/data6/current/blk_-5455871274990294667
2013-10-31 16:21:46,269 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:46,269 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:46,269 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:46,269 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_-2116369040 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:46,279 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:46,279 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:46,279 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:46,279 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_1747797240 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:46,285 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:46,285 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:46,285 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:21:46,285 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_2019793849 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:48,576 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000006_0 0.0% setup
2013-10-31 16:21:48,579 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000006_0 is done.
2013-10-31 16:21:48,579 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000006_0  was -1
2013-10-31 16:21:48,579 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:49,032 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000006_0' has completed task_20131031160444934_0038_m_000006 successfully.
2013-10-31 16:21:49,036 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000000_0' to tip task_20131031160444934_0038_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:49,037 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000000
2013-10-31 16:21:49,037 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000001_0' to tip task_20131031160444934_0038_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:49,038 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000001
2013-10-31 16:21:49,040 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000002_0' to tip task_20131031160444934_0038_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:21:49,041 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:21:49,041 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000002
2013-10-31 16:21:49,042 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:21:49,042 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000003_0' to tip task_20131031160444934_0038_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:21:49,043 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000000_0 which needs 1 slots
2013-10-31 16:21:49,043 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000000_0 which needs 1 slots
2013-10-31 16:21:49,043 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000003
2013-10-31 16:21:49,043 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000001_0 which needs 1 slots
2013-10-31 16:21:49,044 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0038_m_000001_0 which needs 1 slots
2013-10-31 16:21:49,048 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:21:49,052 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:21:49,053 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000002_0 which needs 1 slots
2013-10-31 16:21:49,053 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000002_0 which needs 1 slots
2013-10-31 16:21:49,053 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000003_0 which needs 1 slots
2013-10-31 16:21:49,054 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0038_m_000003_0 which needs 1 slots
2013-10-31 16:21:49,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken	dst=null	perm=null
2013-10-31 16:21:49,063 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37036, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5702328025413530424_1444, duration: 291374
2013-10-31 16:21:49,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml	dst=null	perm=null
2013-10-31 16:21:49,074 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37038, bytes: 27826, op: HDFS_READ, cliID: DFSClient_1012918024, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6236331253892733936_1441, duration: 375971
2013-10-31 16:21:49,096 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000004_0' to tip task_20131031160444934_0038_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:21:49,096 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000004
2013-10-31 16:21:49,099 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:21:49,099 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000004_0 which needs 1 slots
2013-10-31 16:21:49,099 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000004_0 which needs 1 slots
2013-10-31 16:21:49,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken	dst=null	perm=null
2013-10-31 16:21:49,108 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37039, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5702328025413530424_1444, duration: 266969
2013-10-31 16:21:49,113 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-1882149955
2013-10-31 16:21:49,115 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-1882149955 spawned.
2013-10-31 16:21:49,116 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0038/attempt_20131031160444934_0038_m_000000_0. Attempting to reuse: jvm_20131031160444934_0038_m_-693609248
2013-10-31 16:21:49,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml	dst=null	perm=null
2013-10-31 16:21:49,119 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000001_0/taskjvm.sh
2013-10-31 16:21:49,122 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36972, bytes: 27826, op: HDFS_READ, cliID: DFSClient_-430993833, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6236331253892733936_1441, duration: 403280
2013-10-31 16:21:49,126 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:49,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar	dst=null	perm=null
2013-10-31 16:21:49,153 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:49,154 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50075, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1012918024, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5735244170345871603_1438, duration: 590265
2013-10-31 16:21:49,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar	dst=null	perm=null
2013-10-31 16:21:49,177 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36974, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-430993833, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5735244170345871603_1438, duration: 591335
2013-10-31 16:21:49,342 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-1346237540
2013-10-31 16:21:49,344 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-1346237540 spawned.
2013-10-31 16:21:49,346 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-138801878
2013-10-31 16:21:49,346 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-296060093
2013-10-31 16:21:49,347 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-138801878 spawned.
2013-10-31 16:21:49,348 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-296060093 spawned.
2013-10-31 16:21:49,349 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000003_0/taskjvm.sh
2013-10-31 16:21:49,352 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000004_0/taskjvm.sh
2013-10-31 16:21:49,352 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000002_0/taskjvm.sh
2013-10-31 16:21:49,434 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-693609248 given task: attempt_20131031160444934_0038_m_000000_0
2013-10-31 16:21:50,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split	dst=null	perm=null
2013-10-31 16:21:50,205 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36976, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3057745973757760936_1439, duration: 166156
2013-10-31 16:21:50,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:50,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:50,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:50,470 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37046, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 137006
2013-10-31 16:21:50,476 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000. blk_7257285807569140874_1445
2013-10-31 16:21:50,491 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7257285807569140874_1445 src: /127.0.0.1:37047 dest: /127.0.0.1:38271
2013-10-31 16:21:50,492 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7257285807569140874_1445 src: /127.0.0.1:50081 dest: /127.0.0.1:47311
2013-10-31 16:21:50,493 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7257285807569140874_1445 src: /127.0.0.1:57085 dest: /127.0.0.1:41648
2013-10-31 16:21:50,495 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57085, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7257285807569140874_1445, duration: 1365565
2013-10-31 16:21:50,496 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7257285807569140874_1445 terminating
2013-10-31 16:21:50,496 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50081, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7257285807569140874_1445, duration: 1589738
2013-10-31 16:21:50,496 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7257285807569140874_1445 terminating
2013-10-31 16:21:50,496 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37047, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7257285807569140874_1445, duration: 2178141
2013-10-31 16:21:50,497 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7257285807569140874_1445 terminating
2013-10-31 16:21:50,497 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7257285807569140874_1445 size 8
2013-10-31 16:21:50,497 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7257285807569140874_1445 size 8
2013-10-31 16:21:50,498 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0038_m_000000_0
2013-10-31 16:21:50,498 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0038_m_000000_0
2013-10-31 16:21:50,499 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7257285807569140874_1445 size 8
2013-10-31 16:21:50,537 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:50,537 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000000_0 0.0% 
2013-10-31 16:21:50,960 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-1882149955 given task: attempt_20131031160444934_0038_m_000001_0
2013-10-31 16:21:50,966 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-1346237540 given task: attempt_20131031160444934_0038_m_000003_0
2013-10-31 16:21:50,971 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-296060093 given task: attempt_20131031160444934_0038_m_000004_0
2013-10-31 16:21:50,987 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-138801878 given task: attempt_20131031160444934_0038_m_000002_0
2013-10-31 16:21:51,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split	dst=null	perm=null
2013-10-31 16:21:51,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split	dst=null	perm=null
2013-10-31 16:21:51,485 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36989, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3057745973757760936_1439, duration: 162346
2013-10-31 16:21:51,487 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57095, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3057745973757760936_1439, duration: 165161
2013-10-31 16:21:51,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split	dst=null	perm=null
2013-10-31 16:21:51,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split	dst=null	perm=null
2013-10-31 16:21:51,498 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50094, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3057745973757760936_1439, duration: 149943
2013-10-31 16:21:51,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36991, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3057745973757760936_1439, duration: 149438
2013-10-31 16:21:51,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:51,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:51,525 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50095, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 127299
2013-10-31 16:21:51,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37063, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 120469
2013-10-31 16:21:51,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:51,539 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36995, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 109587
2013-10-31 16:21:51,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:51,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:21:51,542 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37065, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 101771
2013-10-31 16:21:51,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:51,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,046 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000000_0
2013-10-31 16:21:52,048 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002. blk_3508700753567488286_1447
2013-10-31 16:21:52,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3508700753567488286_1447 src: /127.0.0.1:37066 dest: /127.0.0.1:38271
2013-10-31 16:21:52,073 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3508700753567488286_1447 src: /127.0.0.1:50100 dest: /127.0.0.1:47311
2013-10-31 16:21:52,074 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3508700753567488286_1447 src: /127.0.0.1:36999 dest: /127.0.0.1:50942
2013-10-31 16:21:52,079 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36999, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3508700753567488286_1447, duration: 3419106
2013-10-31 16:21:52,081 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3508700753567488286_1447 terminating
2013-10-31 16:21:52,083 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3508700753567488286_1447 size 8
2013-10-31 16:21:52,083 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50100, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3508700753567488286_1447, duration: 7297332
2013-10-31 16:21:52,084 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3508700753567488286_1447 terminating
2013-10-31 16:21:52,084 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37066, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3508700753567488286_1447, duration: 8230071
2013-10-31 16:21:52,085 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3508700753567488286_1447 size 8
2013-10-31 16:21:52,085 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3508700753567488286_1447 terminating
2013-10-31 16:21:52,086 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0038_m_000002_0
2013-10-31 16:21:52,086 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0038_m_000002_0
2013-10-31 16:21:52,088 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3508700753567488286_1447 size 8
2013-10-31 16:21:52,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:52,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:52,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,266 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:52,267 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000002_0 0.0% 
2013-10-31 16:21:52,400 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003. blk_8666229121821947994_1449
2013-10-31 16:21:52,413 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004. blk_521913585338677058_1449
2013-10-31 16:21:52,419 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001. blk_7403056687973047624_1449
2013-10-31 16:21:52,423 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8666229121821947994_1449 src: /127.0.0.1:37000 dest: /127.0.0.1:50942
2013-10-31 16:21:52,424 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8666229121821947994_1449 src: /127.0.0.1:57108 dest: /127.0.0.1:41648
2013-10-31 16:21:52,425 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8666229121821947994_1449 src: /127.0.0.1:37073 dest: /127.0.0.1:38271
2013-10-31 16:21:52,427 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37073, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8666229121821947994_1449, duration: 1338311
2013-10-31 16:21:52,427 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8666229121821947994_1449 terminating
2013-10-31 16:21:52,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57108, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8666229121821947994_1449, duration: 1689289
2013-10-31 16:21:52,428 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8666229121821947994_1449 terminating
2013-10-31 16:21:52,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37000, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8666229121821947994_1449, duration: 2050800
2013-10-31 16:21:52,428 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8666229121821947994_1449 terminating
2013-10-31 16:21:52,430 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8666229121821947994_1449 size 8
2013-10-31 16:21:52,431 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8666229121821947994_1449 size 8
2013-10-31 16:21:52,432 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8666229121821947994_1449 size 8
2013-10-31 16:21:52,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7403056687973047624_1449 src: /127.0.0.1:50104 dest: /127.0.0.1:47311
2013-10-31 16:21:52,443 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7403056687973047624_1449 src: /127.0.0.1:57110 dest: /127.0.0.1:41648
2013-10-31 16:21:52,444 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7403056687973047624_1449 src: /127.0.0.1:37006 dest: /127.0.0.1:50942
2013-10-31 16:21:52,446 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_521913585338677058_1449 src: /127.0.0.1:50103 dest: /127.0.0.1:47311
2013-10-31 16:21:52,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37006, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7403056687973047624_1449, duration: 1121032
2013-10-31 16:21:52,446 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7403056687973047624_1449 size 8
2013-10-31 16:21:52,446 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7403056687973047624_1449 terminating
2013-10-31 16:21:52,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57110, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7403056687973047624_1449, duration: 1632066
2013-10-31 16:21:52,446 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7403056687973047624_1449 terminating
2013-10-31 16:21:52,447 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50104, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7403056687973047624_1449, duration: 2038354
2013-10-31 16:21:52,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_521913585338677058_1449 src: /127.0.0.1:37076 dest: /127.0.0.1:38271
2013-10-31 16:21:52,447 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7403056687973047624_1449 terminating
2013-10-31 16:21:52,448 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_521913585338677058_1449 src: /127.0.0.1:57113 dest: /127.0.0.1:41648
2013-10-31 16:21:52,448 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0038_m_000001_0
2013-10-31 16:21:52,448 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0038_m_000001_0
2013-10-31 16:21:52,449 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7403056687973047624_1449 size 8
2013-10-31 16:21:52,449 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7403056687973047624_1449 size 8
2013-10-31 16:21:52,450 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57113, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_521913585338677058_1449, duration: 1171221
2013-10-31 16:21:52,450 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_521913585338677058_1449 terminating
2013-10-31 16:21:52,450 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_521913585338677058_1449 size 8
2013-10-31 16:21:52,450 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37076, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_521913585338677058_1449, duration: 1512443
2013-10-31 16:21:52,450 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_521913585338677058_1449 terminating
2013-10-31 16:21:52,451 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50103, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_521913585338677058_1449, duration: 2078712
2013-10-31 16:21:52,451 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_521913585338677058_1449 terminating
2013-10-31 16:21:52,452 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0038_m_000004_0
2013-10-31 16:21:52,452 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0038_m_000004_0
2013-10-31 16:21:52,453 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_521913585338677058_1449 size 8
2013-10-31 16:21:52,453 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_521913585338677058_1449 size 8
2013-10-31 16:21:52,500 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:52,501 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000001_0 0.0% 
2013-10-31 16:21:52,502 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:52,503 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000004_0 0.0% 
2013-10-31 16:21:52,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0	dst=null	perm=null
2013-10-31 16:21:52,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:52,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0	dst=null	perm=null
2013-10-31 16:21:52,830 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0038_m_000003_0
2013-10-31 16:21:52,831 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0038_m_000003_0
2013-10-31 16:21:52,897 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:52,897 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000003_0 0.0% 
2013-10-31 16:21:53,161 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:21:53,163 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000000_0 is done.
2013-10-31 16:21:53,163 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000000_0  was -1
2013-10-31 16:21:53,163 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:21:54,043 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0038_m_000006_0
2013-10-31 16:21:54,043 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0038_m_000006_0
2013-10-31 16:21:54,043 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000006_0 not found in cache
2013-10-31 16:21:55,050 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000000_0' has completed task_20131031160444934_0038_m_000000 successfully.
2013-10-31 16:21:55,052 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000001_0
2013-10-31 16:21:55,054 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000002_0
2013-10-31 16:21:55,054 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000003_0
2013-10-31 16:21:55,107 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000004_0
2013-10-31 16:21:55,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0	dst=null	perm=null
2013-10-31 16:21:55,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:55,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:55,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0	dst=null	perm=null
2013-10-31 16:21:55,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0	dst=null	perm=null
2013-10-31 16:21:55,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0	dst=null	perm=null
2013-10-31 16:21:55,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:55,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:55,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:55,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:55,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0	dst=null	perm=null
2013-10-31 16:21:55,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0	dst=null	perm=null
2013-10-31 16:21:55,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0	dst=null	perm=null
2013-10-31 16:21:55,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:56,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:56,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0	dst=null	perm=null
2013-10-31 16:21:57,453 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:21:57,453 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:21:57,455 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:21:57,455 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:21:57,455 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:21:57,455 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000003_0 is done.
2013-10-31 16:21:57,455 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000003_0  was -1
2013-10-31 16:21:57,455 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000002_0 is done.
2013-10-31 16:21:57,456 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000002_0  was -1
2013-10-31 16:21:57,456 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:21:57,456 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:57,457 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:21:57,457 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000004_0 is done.
2013-10-31 16:21:57,457 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000004_0  was -1
2013-10-31 16:21:57,457 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:57,463 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:21:57,465 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:21:57,465 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000001_0 is done.
2013-10-31 16:21:57,465 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000001_0  was -1
2013-10-31 16:21:57,466 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:58,056 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000001_0' has completed task_20131031160444934_0038_m_000001 successfully.
2013-10-31 16:21:58,059 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000002_0' has completed task_20131031160444934_0038_m_000002 successfully.
2013-10-31 16:21:58,060 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000003_0' has completed task_20131031160444934_0038_m_000003 successfully.
2013-10-31 16:21:58,111 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000004_0' has completed task_20131031160444934_0038_m_000004 successfully.
2013-10-31 16:21:58,113 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0038_m_000005_0' to tip task_20131031160444934_0038_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:21:58,116 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:21:58,116 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000005_0 which needs 1 slots
2013-10-31 16:21:58,116 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000005_0 which needs 1 slots
2013-10-31 16:21:58,153 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_881681325
2013-10-31 16:21:58,154 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_881681325 spawned.
2013-10-31 16:21:58,156 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000005_0/taskjvm.sh
2013-10-31 16:21:59,057 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_881681325 given task: attempt_20131031160444934_0038_m_000005_0
2013-10-31 16:21:59,597 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000005_0 0.0% 
2013-10-31 16:21:59,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary	dst=null	perm=null
2013-10-31 16:21:59,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:59,622 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_SUCCESS from client DFSClient_attempt_20131031160444934_0038_m_000005_0
2013-10-31 16:21:59,622 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0038_m_000005_0
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5735244170345871603 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5735244170345871603 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5735244170345871603 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5735244170345871603 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3057745973757760936 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3057745973757760936 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3057745973757760936 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3057745973757760936 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:59,628 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6822661847235725823 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:59,629 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6822661847235725823 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:59,629 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6822661847235725823 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:59,629 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6236331253892733936 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:59,629 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6236331253892733936 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:59,629 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6236331253892733936 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:59,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038	dst=null	perm=null
2013-10-31 16:22:00,386 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_3057745973757760936_1439 blk_6822661847235725823_1440 blk_5735244170345871603_1438 blk_6236331253892733936_1441
2013-10-31 16:22:00,387 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_3057745973757760936_1439 blk_6822661847235725823_1440 blk_5735244170345871603_1438
2013-10-31 16:22:00,568 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3057745973757760936_1439 file build/test/data/dfs/data/data3/current/blk_3057745973757760936 for deletion
2013-10-31 16:22:00,568 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5735244170345871603_1438 file build/test/data/dfs/data/data4/current/blk_5735244170345871603 for deletion
2013-10-31 16:22:00,568 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3057745973757760936_1439 at file build/test/data/dfs/data/data3/current/blk_3057745973757760936
2013-10-31 16:22:00,569 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6822661847235725823_1440 file build/test/data/dfs/data/data4/current/blk_6822661847235725823 for deletion
2013-10-31 16:22:00,569 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5735244170345871603_1438 at file build/test/data/dfs/data/data4/current/blk_5735244170345871603
2013-10-31 16:22:00,569 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6822661847235725823_1440 at file build/test/data/dfs/data/data4/current/blk_6822661847235725823
2013-10-31 16:22:02,511 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000005_0 0.0% cleanup
2013-10-31 16:22:02,513 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000005_0 is done.
2013-10-31 16:22:02,513 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000005_0  was -1
2013-10-31 16:22:02,513 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:03,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3057745973757760936_1439 file build/test/data/dfs/data/data7/current/blk_3057745973757760936 for deletion
2013-10-31 16:22:03,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5735244170345871603_1438 file build/test/data/dfs/data/data8/current/blk_5735244170345871603 for deletion
2013-10-31 16:22:03,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3057745973757760936_1439 at file build/test/data/dfs/data/data7/current/blk_3057745973757760936
2013-10-31 16:22:03,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6236331253892733936_1441 file build/test/data/dfs/data/data7/current/blk_6236331253892733936 for deletion
2013-10-31 16:22:03,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5735244170345871603_1438 at file build/test/data/dfs/data/data8/current/blk_5735244170345871603
2013-10-31 16:22:03,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6236331253892733936_1441 at file build/test/data/dfs/data/data7/current/blk_6236331253892733936
2013-10-31 16:22:03,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6822661847235725823_1440 file build/test/data/dfs/data/data8/current/blk_6822661847235725823 for deletion
2013-10-31 16:22:03,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6822661847235725823_1440 at file build/test/data/dfs/data/data8/current/blk_6822661847235725823
2013-10-31 16:22:03,387 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_3057745973757760936_1439 blk_6822661847235725823_1440 blk_5735244170345871603_1438 blk_6236331253892733936_1441
2013-10-31 16:22:03,387 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_3057745973757760936_1439 blk_5735244170345871603_1438 blk_6236331253892733936_1441
2013-10-31 16:22:04,123 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000005_0' has completed task_20131031160444934_0038_m_000005 successfully.
2013-10-31 16:22:04,123 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0038 has completed successfully.
2013-10-31 16:22:04,123 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0038,submitTime=1383236500326,launchTime=1383236502497,firstMapTaskLaunchTime=1383236509036,firstJobSetupTaskLaunchTime=1383236503015,firstJobCleanupTaskLaunchTime=1383236518113,finishTime=1383236524123,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[944271F8E07F49FEA1EC679C06496DBC/AD8E6875136742E7B9682B8648BD7614] lower/(1/1) ...dedpipesplatform/samepipe
2013-10-31 16:22:04,128 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7. blk_3186721410777258518_1450
2013-10-31 16:22:04,130 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3186721410777258518_1450 src: /127.0.0.1:37083 dest: /127.0.0.1:38271
2013-10-31 16:22:04,131 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3186721410777258518_1450 src: /127.0.0.1:37015 dest: /127.0.0.1:50942
2013-10-31 16:22:04,133 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3186721410777258518_1450 src: /127.0.0.1:50118 dest: /127.0.0.1:47311
2013-10-31 16:22:04,156 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50118, dest: /127.0.0.1:47311, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3186721410777258518_1450, duration: 12396924
2013-10-31 16:22:04,157 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3186721410777258518_1450 terminating
2013-10-31 16:22:04,157 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37015, dest: /127.0.0.1:50942, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3186721410777258518_1450, duration: 13233511
2013-10-31 16:22:04,157 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3186721410777258518_1450 terminating
2013-10-31 16:22:04,158 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3186721410777258518_1450 size 26339
2013-10-31 16:22:04,159 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37083, dest: /127.0.0.1:38271, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3186721410777258518_1450, duration: 11443061
2013-10-31 16:22:04,159 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3186721410777258518_1450 terminating
2013-10-31 16:22:04,172 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3186721410777258518_1450 size 26339
2013-10-31 16:22:04,172 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7 from client DFSClient_1423648074
2013-10-31 16:22:04,173 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7 is closed by DFSClient_1423648074
2013-10-31 16:22:04,173 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3186721410777258518_1450 size 26339
2013-10-31 16:22:04,180 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:04,181 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000004_0'
2013-10-31 16:22:04,181 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000005_0'
2013-10-31 16:22:04,182 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5702328025413530424 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:04,182 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5702328025413530424 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:04,183 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5702328025413530424 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:04,186 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0038_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:04,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3057745973757760936_1439 file build/test/data/dfs/data/data5/current/blk_3057745973757760936 for deletion
2013-10-31 16:22:04,189 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3057745973757760936_1439 at file build/test/data/dfs/data/data5/current/blk_3057745973757760936
2013-10-31 16:22:04,189 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5735244170345871603_1438 file build/test/data/dfs/data/data6/current/blk_5735244170345871603 for deletion
2013-10-31 16:22:04,190 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6236331253892733936_1441 file build/test/data/dfs/data/data5/current/blk_6236331253892733936 for deletion
2013-10-31 16:22:04,190 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary
2013-10-31 16:22:04,190 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6236331253892733936_1441 at file build/test/data/dfs/data/data5/current/blk_6236331253892733936
2013-10-31 16:22:04,190 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6822661847235725823_1440 file build/test/data/dfs/data/data6/current/blk_6822661847235725823 for deletion
2013-10-31 16:22:04,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038	dst=null	perm=null
2013-10-31 16:22:04,190 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5735244170345871603_1438 at file build/test/data/dfs/data/data6/current/blk_5735244170345871603
2013-10-31 16:22:04,191 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6822661847235725823_1440 at file build/test/data/dfs/data/data6/current/blk_6822661847235725823
2013-10-31 16:22:04,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2013-10-31 16:22:04,248 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:04,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2013-10-31 16:22:04,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2013-10-31 16:22:04,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2013-10-31 16:22:04,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2013-10-31 16:22:04,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2013-10-31 16:22:04,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2013-10-31 16:22:04,256 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57123, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7257285807569140874_1445, duration: 141803
2013-10-31 16:22:04,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2013-10-31 16:22:04,258 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50121, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7403056687973047624_1449, duration: 106146
2013-10-31 16:22:04,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2013-10-31 16:22:04,261 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37089, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3508700753567488286_1447, duration: 284805
2013-10-31 16:22:04,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2013-10-31 16:22:04,263 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37090, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8666229121821947994_1449, duration: 112253
2013-10-31 16:22:04,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2013-10-31 16:22:04,265 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57127, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_521913585338677058_1449, duration: 105927
2013-10-31 16:22:04,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2013-10-31 16:22:04,283 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:04,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2013-10-31 16:22:04,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2013-10-31 16:22:04,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2013-10-31 16:22:04,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2013-10-31 16:22:04,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2013-10-31 16:22:04,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2013-10-31 16:22:04,290 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57128, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7257285807569140874_1445, duration: 263141
2013-10-31 16:22:04,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2013-10-31 16:22:04,293 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57129, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7403056687973047624_1449, duration: 253280
2013-10-31 16:22:04,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2013-10-31 16:22:04,296 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50127, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3508700753567488286_1447, duration: 268703
2013-10-31 16:22:04,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2013-10-31 16:22:04,299 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37095, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8666229121821947994_1449, duration: 259818
2013-10-31 16:22:04,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2013-10-31 16:22:04,302 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50129, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_521913585338677058_1449, duration: 251217
2013-10-31 16:22:04,302 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/samepipe
2013-10-31 16:22:04,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2013-10-31 16:22:04,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2013-10-31 16:22:04,311 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57133, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7257285807569140874_1445, duration: 354002
2013-10-31 16:22:04,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2013-10-31 16:22:04,315 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57134, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7403056687973047624_1449, duration: 249994
2013-10-31 16:22:04,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2013-10-31 16:22:04,319 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37099, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3508700753567488286_1447, duration: 260533
2013-10-31 16:22:04,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2013-10-31 16:22:04,323 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57136, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8666229121821947994_1449, duration: 260179
2013-10-31 16:22:04,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2013-10-31 16:22:04,328 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50134, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_521913585338677058_1449, duration: 243950
2013-10-31 16:22:04,350 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:22:04,350 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:22:04,361 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:22:04,361 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt"]
2013-10-31 16:22:04,362 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt"]
2013-10-31 16:22:04,362 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextDelimited[[0:3]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter"]
2013-10-31 16:22:04,363 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:22:04,363 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:22:04,363 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:22:04,364 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...esplatform/joininnerouter
2013-10-31 16:22:04,367 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:22:04,367 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:22:04,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:04,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:22:04,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,413 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar. blk_-597700145908871906_1451
2013-10-31 16:22:04,414 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-597700145908871906_1451 src: /127.0.0.1:57138 dest: /127.0.0.1:41648
2013-10-31 16:22:04,416 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-597700145908871906_1451 src: /127.0.0.1:37103 dest: /127.0.0.1:38271
2013-10-31 16:22:04,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-597700145908871906_1451 src: /127.0.0.1:37035 dest: /127.0.0.1:50942
2013-10-31 16:22:04,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37035, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-597700145908871906_1451, duration: 3855195
2013-10-31 16:22:04,425 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-597700145908871906_1451 terminating
2013-10-31 16:22:04,427 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-597700145908871906_1451 size 238055
2013-10-31 16:22:04,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37103, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-597700145908871906_1451, duration: 5025458
2013-10-31 16:22:04,447 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-597700145908871906_1451 terminating
2013-10-31 16:22:04,450 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57138, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-597700145908871906_1451, duration: 26324049
2013-10-31 16:22:04,450 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-597700145908871906_1451 size 238055
2013-10-31 16:22:04,451 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-597700145908871906_1451 terminating
2013-10-31 16:22:04,453 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar from client DFSClient_1457307213
2013-10-31 16:22:04,454 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar is closed by DFSClient_1457307213
2013-10-31 16:22:04,454 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-597700145908871906_1451 size 238055
2013-10-31 16:22:04,467 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar. New replication is 10
2013-10-31 16:22:04,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar	dst=null	perm=null
2013-10-31 16:22:04,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,487 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:22:04,491 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:22:04,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:04,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,514 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split. New replication is 10
2013-10-31 16:22:04,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split	dst=null	perm=null
2013-10-31 16:22:04,523 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split. blk_8675290507838488823_1452
2013-10-31 16:22:04,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8675290507838488823_1452 src: /127.0.0.1:37105 dest: /127.0.0.1:38271
2013-10-31 16:22:04,526 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8675290507838488823_1452 src: /127.0.0.1:57142 dest: /127.0.0.1:41648
2013-10-31 16:22:04,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8675290507838488823_1452 src: /127.0.0.1:37038 dest: /127.0.0.1:50942
2013-10-31 16:22:04,530 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8675290507838488823_1452 src: /127.0.0.1:50141 dest: /127.0.0.1:47311
2013-10-31 16:22:04,533 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50141, dest: /127.0.0.1:47311, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8675290507838488823_1452, duration: 82128
2013-10-31 16:22:04,533 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8675290507838488823_1452 terminating
2013-10-31 16:22:04,534 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37038, dest: /127.0.0.1:50942, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8675290507838488823_1452, duration: 850907
2013-10-31 16:22:04,534 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8675290507838488823_1452 terminating
2013-10-31 16:22:04,535 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57142, dest: /127.0.0.1:41648, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8675290507838488823_1452, duration: 1778546
2013-10-31 16:22:04,535 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8675290507838488823_1452 terminating
2013-10-31 16:22:04,536 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37105, dest: /127.0.0.1:38271, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8675290507838488823_1452, duration: 2863862
2013-10-31 16:22:04,536 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8675290507838488823_1452 terminating
2013-10-31 16:22:04,539 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8675290507838488823_1452 size 1757
2013-10-31 16:22:04,539 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split from client DFSClient_1457307213
2013-10-31 16:22:04,540 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split is closed by DFSClient_1457307213
2013-10-31 16:22:04,540 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8675290507838488823_1452 size 1757
2013-10-31 16:22:04,541 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8675290507838488823_1452 size 1757
2013-10-31 16:22:04,541 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8675290507838488823_1452 size 1757
2013-10-31 16:22:04,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,560 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo. blk_-1884129492925356079_1453
2013-10-31 16:22:04,562 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1884129492925356079_1453 src: /127.0.0.1:57145 dest: /127.0.0.1:41648
2013-10-31 16:22:04,563 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1884129492925356079_1453 src: /127.0.0.1:50143 dest: /127.0.0.1:47311
2013-10-31 16:22:04,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1884129492925356079_1453 src: /127.0.0.1:37043 dest: /127.0.0.1:50942
2013-10-31 16:22:04,568 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37043, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1884129492925356079_1453, duration: 1198207
2013-10-31 16:22:04,568 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1884129492925356079_1453 terminating
2013-10-31 16:22:04,568 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50143, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1884129492925356079_1453, duration: 875934
2013-10-31 16:22:04,569 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1884129492925356079_1453 terminating
2013-10-31 16:22:04,569 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57145, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1884129492925356079_1453, duration: 1684766
2013-10-31 16:22:04,570 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1884129492925356079_1453 size 183
2013-10-31 16:22:04,570 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1884129492925356079_1453 terminating
2013-10-31 16:22:04,572 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1884129492925356079_1453 size 183
2013-10-31 16:22:04,572 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:22:04,573 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:22:04,573 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1884129492925356079_1453 size 183
2013-10-31 16:22:05,561 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0038
2013-10-31 16:22:05,561 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0038 being deleted.
2013-10-31 16:22:05,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,812 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2422 Total time for transactions(ms): 53Number of transactions batched in Syncs: 268 Number of syncs: 1739 SyncTimes(ms): 83893 16993 
2013-10-31 16:22:05,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,825 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml. blk_-4918846354399814783_1454
2013-10-31 16:22:05,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4918846354399814783_1454 src: /127.0.0.1:37044 dest: /127.0.0.1:50942
2013-10-31 16:22:05,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4918846354399814783_1454 src: /127.0.0.1:57150 dest: /127.0.0.1:41648
2013-10-31 16:22:05,831 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4918846354399814783_1454 src: /127.0.0.1:50148 dest: /127.0.0.1:47311
2013-10-31 16:22:05,834 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50148, dest: /127.0.0.1:47311, bytes: 28980, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4918846354399814783_1454, duration: 221307
2013-10-31 16:22:05,835 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4918846354399814783_1454 terminating
2013-10-31 16:22:05,835 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57150, dest: /127.0.0.1:41648, bytes: 28980, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4918846354399814783_1454, duration: 1132463
2013-10-31 16:22:05,835 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4918846354399814783_1454 terminating
2013-10-31 16:22:05,836 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4918846354399814783_1454 size 28980
2013-10-31 16:22:05,836 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37044, dest: /127.0.0.1:50942, bytes: 28980, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4918846354399814783_1454, duration: 1969516
2013-10-31 16:22:05,836 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4918846354399814783_1454 terminating
2013-10-31 16:22:05,836 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4918846354399814783_1454 size 28980
2013-10-31 16:22:05,838 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml from client DFSClient_1457307213
2013-10-31 16:22:05,839 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml is closed by DFSClient_1457307213
2013-10-31 16:22:05,840 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4918846354399814783_1454 size 28980
2013-10-31 16:22:05,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml	dst=null	perm=null
2013-10-31 16:22:05,854 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50150, bytes: 29208, op: HDFS_READ, cliID: DFSClient_516062909, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4918846354399814783_1454, duration: 406187
2013-10-31 16:22:05,871 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0039: nMaps=5 nReduces=0 max=-1
2013-10-31 16:22:05,871 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0039 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:22:05,871 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0039	RESULT=SUCCESS
2013-10-31 16:22:05,871 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0039
2013-10-31 16:22:05,871 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0039
2013-10-31 16:22:05,872 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0039
2013-10-31 16:22:05,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,905 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_conf.xml. blk_-3551340103892272393_1456
2013-10-31 16:22:05,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3551340103892272393_1456 src: /127.0.0.1:37118 dest: /127.0.0.1:38271
2013-10-31 16:22:05,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3551340103892272393_1456 src: /127.0.0.1:57155 dest: /127.0.0.1:41648
2013-10-31 16:22:05,909 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3551340103892272393_1456 src: /127.0.0.1:37051 dest: /127.0.0.1:50942
2013-10-31 16:22:05,914 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37051, dest: /127.0.0.1:50942, bytes: 29045, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3551340103892272393_1456, duration: 733852
2013-10-31 16:22:05,914 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3551340103892272393_1456 terminating
2013-10-31 16:22:05,915 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57155, dest: /127.0.0.1:41648, bytes: 29045, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3551340103892272393_1456, duration: 1871546
2013-10-31 16:22:05,915 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3551340103892272393_1456 size 29045
2013-10-31 16:22:05,915 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3551340103892272393_1456 terminating
2013-10-31 16:22:05,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37118, dest: /127.0.0.1:38271, bytes: 29045, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3551340103892272393_1456, duration: 2698831
2013-10-31 16:22:05,916 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3551340103892272393_1456 size 29045
2013-10-31 16:22:05,916 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3551340103892272393_1456 terminating
2013-10-31 16:22:05,921 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3551340103892272393_1456 size 29045
2013-10-31 16:22:05,921 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_conf.xml from client DFSClient_516062909
2013-10-31 16:22:05,921 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_conf.xml is closed by DFSClient_516062909
2013-10-31 16:22:05,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,935 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken. blk_3283441132058347550_1457
2013-10-31 16:22:05,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3283441132058347550_1457 src: /127.0.0.1:37052 dest: /127.0.0.1:50942
2013-10-31 16:22:05,939 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3283441132058347550_1457 src: /127.0.0.1:57158 dest: /127.0.0.1:41648
2013-10-31 16:22:05,940 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3283441132058347550_1457 src: /127.0.0.1:50156 dest: /127.0.0.1:47311
2013-10-31 16:22:05,943 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50156, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3283441132058347550_1457, duration: 64322
2013-10-31 16:22:05,943 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3283441132058347550_1457 terminating
2013-10-31 16:22:05,944 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57158, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3283441132058347550_1457, duration: 819066
2013-10-31 16:22:05,944 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3283441132058347550_1457 terminating
2013-10-31 16:22:05,945 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37052, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3283441132058347550_1457, duration: 1732414
2013-10-31 16:22:05,945 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3283441132058347550_1457 terminating
2013-10-31 16:22:05,947 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3283441132058347550_1457 size 116
2013-10-31 16:22:05,947 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken from client DFSClient_1457307213
2013-10-31 16:22:05,948 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken is closed by DFSClient_1457307213
2013-10-31 16:22:05,948 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3283441132058347550_1457 size 116
2013-10-31 16:22:05,949 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3283441132058347550_1457 size 116
2013-10-31 16:22:05,954 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken
2013-10-31 16:22:05,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:22:05,959 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57160, bytes: 187, op: HDFS_READ, cliID: DFSClient_516062909, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1884129492925356079_1453, duration: 459078
2013-10-31 16:22:05,960 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0039 = 83. Number of splits = 5
2013-10-31 16:22:05,960 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,960 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,961 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,961 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,961 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,961 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,962 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,962 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,962 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,962 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,964 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0039 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:22:05,964 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0039 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:22:05,970 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3057745973757760936_1439 file build/test/data/dfs/data/data2/current/blk_3057745973757760936 for deletion
2013-10-31 16:22:05,970 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5735244170345871603_1438 file build/test/data/dfs/data/data1/current/blk_5735244170345871603 for deletion
2013-10-31 16:22:05,970 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3057745973757760936_1439 at file build/test/data/dfs/data/data2/current/blk_3057745973757760936
2013-10-31 16:22:05,970 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6236331253892733936_1441 file build/test/data/dfs/data/data1/current/blk_6236331253892733936 for deletion
2013-10-31 16:22:05,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5735244170345871603_1438 at file build/test/data/dfs/data/data1/current/blk_5735244170345871603
2013-10-31 16:22:05,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6236331253892733936_1441 at file build/test/data/dfs/data/data1/current/blk_6236331253892733936
2013-10-31 16:22:06,388 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-597700145908871906_1451 to datanode(s) 127.0.0.1:47311
2013-10-31 16:22:06,389 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_5702328025413530424_1444
2013-10-31 16:22:06,389 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_5702328025413530424_1444
2013-10-31 16:22:07,070 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0039_m_000006_0' to tip task_20131031160444934_0039_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:07,075 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000000_0'
2013-10-31 16:22:07,075 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000001_0'
2013-10-31 16:22:07,075 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000006_0'
2013-10-31 16:22:07,078 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:22:07,078 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000002_0'
2013-10-31 16:22:07,078 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000006_0 which needs 1 slots
2013-10-31 16:22:07,079 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000003_0'
2013-10-31 16:22:07,079 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000006_0 which needs 1 slots
2013-10-31 16:22:07,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken	dst=null	perm=null
2013-10-31 16:22:07,087 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57161, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3283441132058347550_1457, duration: 279116
2013-10-31 16:22:07,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml	dst=null	perm=null
2013-10-31 16:22:07,097 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37058, bytes: 29208, op: HDFS_READ, cliID: DFSClient_597924467, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4918846354399814783_1454, duration: 474909
2013-10-31 16:22:07,128 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:07,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar	dst=null	perm=null
2013-10-31 16:22:07,159 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57164, bytes: 239915, op: HDFS_READ, cliID: DFSClient_597924467, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-597700145908871906_1451, duration: 1276476
2013-10-31 16:22:07,187 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-597700145908871906_1451 to 127.0.0.1:47311 
2013-10-31 16:22:07,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5702328025413530424_1444 file build/test/data/dfs/data/data5/current/subdir63/blk_5702328025413530424 for deletion
2013-10-31 16:22:07,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5702328025413530424_1444 at file build/test/data/dfs/data/data5/current/subdir63/blk_5702328025413530424
2013-10-31 16:22:07,189 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-597700145908871906_1451 src: /127.0.0.1:50162 dest: /127.0.0.1:47311
2013-10-31 16:22:07,189 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-597700145908871906_1451 to /127.0.0.1:47311
2013-10-31 16:22:07,190 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-597700145908871906_1451 src: /127.0.0.1:50162 dest: /127.0.0.1:47311 of size 238055
2013-10-31 16:22:07,195 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-597700145908871906_1451 size 238055
2013-10-31 16:22:07,258 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0038_m_-1882149955
2013-10-31 16:22:07,264 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1738 with signal TERM. Exit code 0
2013-10-31 16:22:07,265 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_-410323460
2013-10-31 16:22:07,265 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_-410323460 spawned.
2013-10-31 16:22:07,268 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000006_0/taskjvm.sh
2013-10-31 16:22:07,348 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:07,348 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:07,348 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:07,348 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-1882149955 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:08,970 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5702328025413530424_1444 file build/test/data/dfs/data/data2/current/blk_5702328025413530424 for deletion
2013-10-31 16:22:08,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5702328025413530424_1444 at file build/test/data/dfs/data/data2/current/blk_5702328025413530424
2013-10-31 16:22:09,182 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0038
2013-10-31 16:22:09,182 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000005_0 not found in cache
2013-10-31 16:22:09,182 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000004_0 not found in cache
2013-10-31 16:22:09,183 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0038 for user-log deletion with retainTimeStamp:1383322929183
2013-10-31 16:22:09,284 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_-410323460 given task: attempt_20131031160444934_0039_m_000006_0
2013-10-31 16:22:09,389 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_5702328025413530424_1444
2013-10-31 16:22:09,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:09,988 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0038_m_-296060093 since job job_20131031160444934_0038 is dead
2013-10-31 16:22:09,996 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1737 with signal TERM. Exit code 0
2013-10-31 16:22:10,181 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:10,182 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:10,182 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:10,182 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-296060093 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:10,576 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0038_m_881681325 since job job_20131031160444934_0038 is dead
2013-10-31 16:22:10,587 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2042 with signal TERM. Exit code 0
2013-10-31 16:22:10,767 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:10,767 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:10,767 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:10,768 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_881681325 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:12,079 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0038
2013-10-31 16:22:12,079 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000001_0 not found in cache
2013-10-31 16:22:12,079 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000000_0 not found in cache
2013-10-31 16:22:12,079 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0038
2013-10-31 16:22:12,080 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000002_0 not found in cache
2013-10-31 16:22:12,080 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0038 for user-log deletion with retainTimeStamp:1383322932080
2013-10-31 16:22:12,080 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000003_0 not found in cache
2013-10-31 16:22:12,081 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0038 for user-log deletion with retainTimeStamp:1383322932081
2013-10-31 16:22:12,182 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5702328025413530424_1444 file build/test/data/dfs/data/data7/current/blk_5702328025413530424 for deletion
2013-10-31 16:22:12,182 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5702328025413530424_1444 at file build/test/data/dfs/data/data7/current/blk_5702328025413530424
2013-10-31 16:22:12,713 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000006_0 0.0% setup
2013-10-31 16:22:12,716 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000006_0 is done.
2013-10-31 16:22:12,716 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000006_0  was -1
2013-10-31 16:22:12,716 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:12,989 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0038_m_-138801878 since job job_20131031160444934_0038 is dead
2013-10-31 16:22:12,999 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1739 with signal TERM. Exit code 0
2013-10-31 16:22:13,000 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0038_m_-1346237540 since job job_20131031160444934_0038 is dead
2013-10-31 16:22:13,011 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1736 with signal TERM. Exit code 0
2013-10-31 16:22:13,084 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000006_0' has completed task_20131031160444934_0039_m_000006 successfully.
2013-10-31 16:22:13,085 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000000_0' to tip task_20131031160444934_0039_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:13,086 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000000
2013-10-31 16:22:13,086 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000001_0' to tip task_20131031160444934_0039_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:13,086 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000001
2013-10-31 16:22:13,087 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000002_0' to tip task_20131031160444934_0039_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:22:13,087 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:22:13,087 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000002
2013-10-31 16:22:13,088 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:22:13,088 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000000_0 which needs 1 slots
2013-10-31 16:22:13,088 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000000_0 which needs 1 slots
2013-10-31 16:22:13,088 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000003_0' to tip task_20131031160444934_0039_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:22:13,088 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000001_0 which needs 1 slots
2013-10-31 16:22:13,088 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0039_m_000001_0 which needs 1 slots
2013-10-31 16:22:13,089 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000003
2013-10-31 16:22:13,093 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:22:13,093 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:22:13,093 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000002_0 which needs 1 slots
2013-10-31 16:22:13,094 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000002_0 which needs 1 slots
2013-10-31 16:22:13,094 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000003_0 which needs 1 slots
2013-10-31 16:22:13,094 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0039_m_000003_0 which needs 1 slots
2013-10-31 16:22:13,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken	dst=null	perm=null
2013-10-31 16:22:13,099 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57168, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3283441132058347550_1457, duration: 257734
2013-10-31 16:22:13,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml	dst=null	perm=null
2013-10-31 16:22:13,105 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57170, bytes: 29208, op: HDFS_READ, cliID: DFSClient_-409063308, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4918846354399814783_1454, duration: 317338
2013-10-31 16:22:13,111 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0039/attempt_20131031160444934_0039_m_000001_0. Attempting to reuse: jvm_20131031160444934_0039_m_-410323460
2013-10-31 16:22:13,117 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0038_m_-693609248
2013-10-31 16:22:13,119 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:13,121 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1547 with signal TERM. Exit code 0
2013-10-31 16:22:13,122 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_814554802
2013-10-31 16:22:13,122 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_814554802 spawned.
2013-10-31 16:22:13,124 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000000_0/taskjvm.sh
2013-10-31 16:22:13,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar	dst=null	perm=null
2013-10-31 16:22:13,136 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57171, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-409063308, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-597700145908871906_1451, duration: 951939
2013-10-31 16:22:13,188 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:13,188 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:13,188 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:13,188 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-1346237540 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:13,190 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000004_0' to tip task_20131031160444934_0039_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:22:13,191 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000004
2013-10-31 16:22:13,192 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:22:13,192 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000004_0 which needs 1 slots
2013-10-31 16:22:13,192 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:13,192 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:13,192 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:13,192 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000004_0 which needs 1 slots
2013-10-31 16:22:13,192 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-138801878 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:13,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken	dst=null	perm=null
2013-10-31 16:22:13,196 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57172, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3283441132058347550_1457, duration: 137837
2013-10-31 16:22:13,198 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_868079514
2013-10-31 16:22:13,200 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_868079514 spawned.
2013-10-31 16:22:13,200 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_-1078247713
2013-10-31 16:22:13,202 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_-1078247713 spawned.
2013-10-31 16:22:13,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml	dst=null	perm=null
2013-10-31 16:22:13,204 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000002_0/taskjvm.sh
2013-10-31 16:22:13,204 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000003_0/taskjvm.sh
2013-10-31 16:22:13,205 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57174, bytes: 29208, op: HDFS_READ, cliID: DFSClient_-791114546, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4918846354399814783_1454, duration: 194635
2013-10-31 16:22:13,213 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0038_m_-693609248
2013-10-31 16:22:13,218 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:13,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar	dst=null	perm=null
2013-10-31 16:22:13,235 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37139, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-791114546, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-597700145908871906_1451, duration: 1339348
2013-10-31 16:22:13,342 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_79344705
2013-10-31 16:22:13,342 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_79344705 spawned.
2013-10-31 16:22:13,343 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000004_0/taskjvm.sh
2013-10-31 16:22:13,523 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_-410323460 given task: attempt_20131031160444934_0039_m_000001_0
2013-10-31 16:22:13,580 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:13,580 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:13,580 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:13,580 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-693609248 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:22:13,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split	dst=null	perm=null
2013-10-31 16:22:13,628 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57177, bytes: 1773, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8675290507838488823_1452, duration: 173788
2013-10-31 16:22:13,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:13,669 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50175, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 114133
2013-10-31 16:22:14,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:14,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:14,199 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_814554802 given task: attempt_20131031160444934_0039_m_000000_0
2013-10-31 16:22:14,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:14,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:14,437 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57180, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 141593
2013-10-31 16:22:14,448 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001. blk_1428969296953013366_1458
2013-10-31 16:22:14,464 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1428969296953013366_1458 src: /127.0.0.1:57181 dest: /127.0.0.1:41648
2013-10-31 16:22:15,059 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1428969296953013366_1458 src: /127.0.0.1:37077 dest: /127.0.0.1:50942
2013-10-31 16:22:15,113 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1428969296953013366_1458 src: /127.0.0.1:37147 dest: /127.0.0.1:38271
2013-10-31 16:22:15,116 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37147, dest: /127.0.0.1:38271, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1428969296953013366_1458, duration: 1812962
2013-10-31 16:22:15,120 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1428969296953013366_1458 size 37
2013-10-31 16:22:15,120 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1428969296953013366_1458 terminating
2013-10-31 16:22:15,120 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37077, dest: /127.0.0.1:50942, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1428969296953013366_1458, duration: 5608814
2013-10-31 16:22:15,120 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1428969296953013366_1458 terminating
2013-10-31 16:22:15,120 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57181, dest: /127.0.0.1:41648, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1428969296953013366_1458, duration: 6049176
2013-10-31 16:22:15,121 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1428969296953013366_1458 terminating
2013-10-31 16:22:15,123 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1428969296953013366_1458 size 37
2013-10-31 16:22:15,123 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0039_m_000001_0
2013-10-31 16:22:15,123 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0039_m_000001_0
2013-10-31 16:22:15,124 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1428969296953013366_1458 size 37
2013-10-31 16:22:15,162 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:15,162 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000001_0 0.0% 
2013-10-31 16:22:15,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split	dst=null	perm=null
2013-10-31 16:22:15,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57185, bytes: 1773, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8675290507838488823_1452, duration: 185056
2013-10-31 16:22:15,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:15,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:15,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:15,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:15,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:15,643 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37150, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 132253
2013-10-31 16:22:15,647 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57187, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 160115
2013-10-31 16:22:15,657 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000. blk_-880140191113664544_1459
2013-10-31 16:22:15,679 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-880140191113664544_1459 src: /127.0.0.1:57188 dest: /127.0.0.1:41648
2013-10-31 16:22:15,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-880140191113664544_1459 src: /127.0.0.1:50186 dest: /127.0.0.1:47311
2013-10-31 16:22:15,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-880140191113664544_1459 src: /127.0.0.1:37154 dest: /127.0.0.1:38271
2013-10-31 16:22:15,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37154, dest: /127.0.0.1:38271, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-880140191113664544_1459, duration: 1036978
2013-10-31 16:22:15,683 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-880140191113664544_1459 terminating
2013-10-31 16:22:15,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50186, dest: /127.0.0.1:47311, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-880140191113664544_1459, duration: 1494176
2013-10-31 16:22:15,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-880140191113664544_1459 terminating
2013-10-31 16:22:15,684 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-880140191113664544_1459 size 120
2013-10-31 16:22:15,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57188, dest: /127.0.0.1:41648, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-880140191113664544_1459, duration: 1882377
2013-10-31 16:22:15,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-880140191113664544_1459 terminating
2013-10-31 16:22:15,685 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0039_m_000000_0
2013-10-31 16:22:15,685 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0039_m_000000_0
2013-10-31 16:22:15,686 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-880140191113664544_1459 size 120
2013-10-31 16:22:15,687 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-880140191113664544_1459 size 120
2013-10-31 16:22:15,893 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_-1078247713 given task: attempt_20131031160444934_0039_m_000003_0
2013-10-31 16:22:15,908 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_79344705 given task: attempt_20131031160444934_0039_m_000004_0
2013-10-31 16:22:15,910 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_868079514 given task: attempt_20131031160444934_0039_m_000002_0
2013-10-31 16:22:16,090 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000001_0
2013-10-31 16:22:16,113 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:16,113 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000000_0 0.0% 
2013-10-31 16:22:16,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0	dst=null	perm=null
2013-10-31 16:22:16,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:16,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:16,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0	dst=null	perm=null
2013-10-31 16:22:16,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split	dst=null	perm=null
2013-10-31 16:22:16,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split	dst=null	perm=null
2013-10-31 16:22:16,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split	dst=null	perm=null
2013-10-31 16:22:16,413 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50194, bytes: 741, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8675290507838488823_1452, duration: 169194
2013-10-31 16:22:16,414 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37162, bytes: 1257, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8675290507838488823_1452, duration: 204206
2013-10-31 16:22:16,415 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50196, bytes: 741, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8675290507838488823_1452, duration: 150070
2013-10-31 16:22:16,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,453 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50197, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 109821
2013-10-31 16:22:16,453 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57201, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 114359
2013-10-31 16:22:16,454 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57202, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 103244
2013-10-31 16:22:16,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:16,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:16,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:16,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:16,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:16,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:16,586 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:20+20
2013-10-31 16:22:16,587 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000001_0 is done.
2013-10-31 16:22:16,587 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000001_0  was -1
2013-10-31 16:22:16,587 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:22:16,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37167, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 136105
2013-10-31 16:22:16,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2013-10-31 16:22:16,720 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57204, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 110055
2013-10-31 16:22:16,722 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57205, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 106715
2013-10-31 16:22:16,726 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002. blk_-3766852199179531138_1462
2013-10-31 16:22:16,733 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004. blk_2307814493574241169_1462
2013-10-31 16:22:16,735 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003. blk_2408232434680552120_1462
2013-10-31 16:22:16,750 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3766852199179531138_1462 src: /127.0.0.1:50203 dest: /127.0.0.1:47311
2013-10-31 16:22:16,750 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3766852199179531138_1462 src: /127.0.0.1:57209 dest: /127.0.0.1:41648
2013-10-31 16:22:16,751 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3766852199179531138_1462 src: /127.0.0.1:37174 dest: /127.0.0.1:38271
2013-10-31 16:22:16,758 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2307814493574241169_1462 src: /127.0.0.1:50204 dest: /127.0.0.1:47311
2013-10-31 16:22:16,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37174, dest: /127.0.0.1:38271, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3766852199179531138_1462, duration: 4900253
2013-10-31 16:22:16,758 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3766852199179531138_1462 terminating
2013-10-31 16:22:16,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57209, dest: /127.0.0.1:41648, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3766852199179531138_1462, duration: 6315418
2013-10-31 16:22:16,759 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3766852199179531138_1462 terminating
2013-10-31 16:22:16,759 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2307814493574241169_1462 src: /127.0.0.1:57211 dest: /127.0.0.1:41648
2013-10-31 16:22:16,759 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50203, dest: /127.0.0.1:47311, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3766852199179531138_1462, duration: 6845133
2013-10-31 16:22:16,759 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3766852199179531138_1462 terminating
2013-10-31 16:22:16,760 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2307814493574241169_1462 src: /127.0.0.1:37176 dest: /127.0.0.1:38271
2013-10-31 16:22:16,760 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2408232434680552120_1462 src: /127.0.0.1:37103 dest: /127.0.0.1:50942
2013-10-31 16:22:16,761 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2408232434680552120_1462 src: /127.0.0.1:50210 dest: /127.0.0.1:47311
2013-10-31 16:22:16,762 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3766852199179531138_1462 size 28
2013-10-31 16:22:16,763 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3766852199179531138_1462 size 28
2013-10-31 16:22:16,763 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2408232434680552120_1462 src: /127.0.0.1:57214 dest: /127.0.0.1:41648
2013-10-31 16:22:16,763 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37176, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2307814493574241169_1462, duration: 1699249
2013-10-31 16:22:16,763 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3766852199179531138_1462 size 28
2013-10-31 16:22:16,763 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2307814493574241169_1462 terminating
2013-10-31 16:22:16,763 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57211, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2307814493574241169_1462, duration: 2411201
2013-10-31 16:22:16,764 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2307814493574241169_1462 terminating
2013-10-31 16:22:16,764 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50204, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2307814493574241169_1462, duration: 3029250
2013-10-31 16:22:16,764 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2307814493574241169_1462 terminating
2013-10-31 16:22:16,766 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57214, dest: /127.0.0.1:41648, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2408232434680552120_1462, duration: 798589
2013-10-31 16:22:16,766 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2408232434680552120_1462 terminating
2013-10-31 16:22:16,766 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2307814493574241169_1462 size 8
2013-10-31 16:22:16,767 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50210, dest: /127.0.0.1:47311, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2408232434680552120_1462, duration: 2069995
2013-10-31 16:22:16,767 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2307814493574241169_1462 size 8
2013-10-31 16:22:16,767 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2408232434680552120_1462 terminating
2013-10-31 16:22:16,767 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2408232434680552120_1462 size 28
2013-10-31 16:22:16,767 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2408232434680552120_1462 size 28
2013-10-31 16:22:16,767 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2307814493574241169_1462 size 8
2013-10-31 16:22:16,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37103, dest: /127.0.0.1:50942, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2408232434680552120_1462, duration: 2648139
2013-10-31 16:22:16,769 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2408232434680552120_1462 terminating
2013-10-31 16:22:16,769 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0039_m_000003_0
2013-10-31 16:22:16,770 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0039_m_000003_0
2013-10-31 16:22:16,771 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2408232434680552120_1462 size 28
2013-10-31 16:22:16,825 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:16,825 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000003_0 0.0% 
2013-10-31 16:22:17,161 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0039_m_000002_0
2013-10-31 16:22:17,162 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0039_m_000002_0
2013-10-31 16:22:17,167 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0039_m_000004_0
2013-10-31 16:22:17,167 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0039_m_000004_0
2013-10-31 16:22:17,220 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:17,220 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000002_0 0.0% 
2013-10-31 16:22:17,222 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:17,222 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000004_0 0.0% 
2013-10-31 16:22:18,088 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0039_m_000006_0
2013-10-31 16:22:18,089 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0039_m_000006_0
2013-10-31 16:22:18,089 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000006_0 not found in cache
2013-10-31 16:22:19,094 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000001_0' has completed task_20131031160444934_0039_m_000001 successfully.
2013-10-31 16:22:19,097 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000000_0
2013-10-31 16:22:19,099 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000002_0
2013-10-31 16:22:19,100 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000003_0
2013-10-31 16:22:19,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0	dst=null	perm=null
2013-10-31 16:22:19,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:19,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:19,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0	dst=null	perm=null
2013-10-31 16:22:19,197 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000004_0
2013-10-31 16:22:19,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0	dst=null	perm=null
2013-10-31 16:22:19,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0	dst=null	perm=null
2013-10-31 16:22:19,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:19,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:19,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:19,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:19,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0	dst=null	perm=null
2013-10-31 16:22:19,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0	dst=null	perm=null
2013-10-31 16:22:19,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0	dst=null	perm=null
2013-10-31 16:22:19,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:19,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:19,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0	dst=null	perm=null
2013-10-31 16:22:21,317 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:0+20
2013-10-31 16:22:21,322 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:0+20
2013-10-31 16:22:21,323 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000000_0 is done.
2013-10-31 16:22:21,323 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000000_0  was -1
2013-10-31 16:22:21,324 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:22,101 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000000_0' has completed task_20131031160444934_0039_m_000000 successfully.
2013-10-31 16:22:22,409 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:60+20
2013-10-31 16:22:22,411 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:60+20
2013-10-31 16:22:22,412 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000003_0 is done.
2013-10-31 16:22:22,412 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000003_0  was -1
2013-10-31 16:22:22,412 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:22:22,415 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:40+20
2013-10-31 16:22:22,418 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:80+3
2013-10-31 16:22:22,424 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:80+3
2013-10-31 16:22:22,425 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:40+20
2013-10-31 16:22:22,426 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000004_0 is done.
2013-10-31 16:22:22,426 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000004_0  was -1
2013-10-31 16:22:22,426 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:22,428 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000002_0 is done.
2013-10-31 16:22:22,428 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000002_0  was -1
2013-10-31 16:22:22,429 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:25,108 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000002_0' has completed task_20131031160444934_0039_m_000002 successfully.
2013-10-31 16:22:25,110 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000003_0' has completed task_20131031160444934_0039_m_000003 successfully.
2013-10-31 16:22:25,204 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000004_0' has completed task_20131031160444934_0039_m_000004 successfully.
2013-10-31 16:22:25,206 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0039_m_000005_0' to tip task_20131031160444934_0039_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:22:25,209 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:22:25,209 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000005_0 which needs 1 slots
2013-10-31 16:22:25,209 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000005_0 which needs 1 slots
2013-10-31 16:22:25,239 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_-1907135464
2013-10-31 16:22:25,240 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_-1907135464 spawned.
2013-10-31 16:22:25,243 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000005_0/taskjvm.sh
2013-10-31 16:22:26,203 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_-1907135464 given task: attempt_20131031160444934_0039_m_000005_0
2013-10-31 16:22:26,737 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000005_0 0.0% 
2013-10-31 16:22:26,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary	dst=null	perm=null
2013-10-31 16:22:26,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:26,756 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_SUCCESS from client DFSClient_attempt_20131031160444934_0039_m_000005_0
2013-10-31 16:22:26,756 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0039_m_000005_0
2013-10-31 16:22:26,762 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-597700145908871906 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:26,762 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-597700145908871906 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:26,762 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-597700145908871906 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-597700145908871906 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8675290507838488823 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8675290507838488823 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8675290507838488823 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8675290507838488823 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1884129492925356079 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1884129492925356079 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1884129492925356079 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4918846354399814783 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4918846354399814783 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:26,763 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4918846354399814783 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:26,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039	dst=null	perm=null
2013-10-31 16:22:27,392 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_-597700145908871906_1451 blk_8675290507838488823_1452
2013-10-31 16:22:27,393 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-1884129492925356079_1453 blk_-597700145908871906_1451 blk_-4918846354399814783_1454 blk_8675290507838488823_1452
2013-10-31 16:22:29,648 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000005_0 0.0% cleanup
2013-10-31 16:22:29,650 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000005_0 is done.
2013-10-31 16:22:29,650 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000005_0  was -1
2013-10-31 16:22:29,650 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:29,977 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-597700145908871906_1451 file build/test/data/dfs/data/data2/current/subdir17/blk_-597700145908871906 for deletion
2013-10-31 16:22:29,977 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8675290507838488823_1452 file build/test/data/dfs/data/data1/current/blk_8675290507838488823 for deletion
2013-10-31 16:22:29,978 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8675290507838488823_1452 at file build/test/data/dfs/data/data1/current/blk_8675290507838488823
2013-10-31 16:22:29,978 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-597700145908871906_1451 at file build/test/data/dfs/data/data2/current/subdir17/blk_-597700145908871906
2013-10-31 16:22:30,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4918846354399814783_1454 file build/test/data/dfs/data/data8/current/blk_-4918846354399814783 for deletion
2013-10-31 16:22:30,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1884129492925356079_1453 file build/test/data/dfs/data/data7/current/blk_-1884129492925356079 for deletion
2013-10-31 16:22:30,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-597700145908871906_1451 file build/test/data/dfs/data/data7/current/blk_-597700145908871906 for deletion
2013-10-31 16:22:30,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4918846354399814783_1454 at file build/test/data/dfs/data/data8/current/blk_-4918846354399814783
2013-10-31 16:22:30,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8675290507838488823_1452 file build/test/data/dfs/data/data8/current/blk_8675290507838488823 for deletion
2013-10-31 16:22:30,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1884129492925356079_1453 at file build/test/data/dfs/data/data7/current/blk_-1884129492925356079
2013-10-31 16:22:30,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8675290507838488823_1452 at file build/test/data/dfs/data/data8/current/blk_8675290507838488823
2013-10-31 16:22:30,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-597700145908871906_1451 at file build/test/data/dfs/data/data7/current/blk_-597700145908871906
2013-10-31 16:22:30,393 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_-1884129492925356079_1453 blk_-597700145908871906_1451 blk_-4918846354399814783_1454 blk_8675290507838488823_1452
2013-10-31 16:22:30,394 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_-1884129492925356079_1453 blk_-597700145908871906_1451 blk_-4918846354399814783_1454 blk_8675290507838488823_1452
2013-10-31 16:22:30,578 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4918846354399814783_1454 file build/test/data/dfs/data/data3/current/blk_-4918846354399814783 for deletion
2013-10-31 16:22:30,578 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1884129492925356079_1453 file build/test/data/dfs/data/data4/current/blk_-1884129492925356079 for deletion
2013-10-31 16:22:30,579 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4918846354399814783_1454 at file build/test/data/dfs/data/data3/current/blk_-4918846354399814783
2013-10-31 16:22:30,579 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1884129492925356079_1453 at file build/test/data/dfs/data/data4/current/blk_-1884129492925356079
2013-10-31 16:22:30,579 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-597700145908871906_1451 file build/test/data/dfs/data/data3/current/blk_-597700145908871906 for deletion
2013-10-31 16:22:30,579 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8675290507838488823_1452 file build/test/data/dfs/data/data3/current/blk_8675290507838488823 for deletion
2013-10-31 16:22:30,580 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-597700145908871906_1451 at file build/test/data/dfs/data/data3/current/blk_-597700145908871906
2013-10-31 16:22:30,580 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8675290507838488823_1452 at file build/test/data/dfs/data/data3/current/blk_8675290507838488823
2013-10-31 16:22:31,195 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4918846354399814783_1454 file build/test/data/dfs/data/data5/current/blk_-4918846354399814783 for deletion
2013-10-31 16:22:31,195 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1884129492925356079_1453 file build/test/data/dfs/data/data6/current/blk_-1884129492925356079 for deletion
2013-10-31 16:22:31,195 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4918846354399814783_1454 at file build/test/data/dfs/data/data5/current/blk_-4918846354399814783
2013-10-31 16:22:31,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1884129492925356079_1453 at file build/test/data/dfs/data/data6/current/blk_-1884129492925356079
2013-10-31 16:22:31,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-597700145908871906_1451 file build/test/data/dfs/data/data6/current/blk_-597700145908871906 for deletion
2013-10-31 16:22:31,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8675290507838488823_1452 file build/test/data/dfs/data/data5/current/blk_8675290507838488823 for deletion
2013-10-31 16:22:31,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-597700145908871906_1451 at file build/test/data/dfs/data/data6/current/blk_-597700145908871906
2013-10-31 16:22:31,197 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8675290507838488823_1452 at file build/test/data/dfs/data/data5/current/blk_8675290507838488823
2013-10-31 16:22:31,216 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000005_0' has completed task_20131031160444934_0039_m_000005 successfully.
2013-10-31 16:22:31,217 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0039 has completed successfully.
2013-10-31 16:22:31,217 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0039,submitTime=1383236525844,launchTime=1383236525964,firstMapTaskLaunchTime=1383236533085,firstJobSetupTaskLaunchTime=1383236527069,firstJobCleanupTaskLaunchTime=1383236545206,finishTime=1383236551217,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=49,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[85B27853B09F4D76BC826C6F41287464/D443F64090B247EEAF88909CD7C78242] lower*upper/(1/1) ...esplatform/joininnerouter
2013-10-31 16:22:31,222 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE. blk_6789732992266141191_1463
2013-10-31 16:22:31,226 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6789732992266141191_1463 src: /127.0.0.1:57220 dest: /127.0.0.1:41648
2013-10-31 16:22:31,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6789732992266141191_1463 src: /127.0.0.1:50218 dest: /127.0.0.1:47311
2013-10-31 16:22:31,230 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6789732992266141191_1463 src: /127.0.0.1:37117 dest: /127.0.0.1:50942
2013-10-31 16:22:31,239 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37117, dest: /127.0.0.1:50942, bytes: 26426, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6789732992266141191_1463, duration: 5129216
2013-10-31 16:22:31,240 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6789732992266141191_1463 terminating
2013-10-31 16:22:31,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50218, dest: /127.0.0.1:47311, bytes: 26426, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6789732992266141191_1463, duration: 5278128
2013-10-31 16:22:31,241 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6789732992266141191_1463 terminating
2013-10-31 16:22:31,241 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6789732992266141191_1463 size 26426
2013-10-31 16:22:31,241 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57220, dest: /127.0.0.1:41648, bytes: 26426, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6789732992266141191_1463, duration: 6598844
2013-10-31 16:22:31,242 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6789732992266141191_1463 terminating
2013-10-31 16:22:31,242 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6789732992266141191_1463 size 26426
2013-10-31 16:22:31,245 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE from client DFSClient_516062909
2013-10-31 16:22:31,245 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE is closed by DFSClient_516062909
2013-10-31 16:22:31,246 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6789732992266141191_1463 size 26426
2013-10-31 16:22:31,253 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:31,254 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000004_0'
2013-10-31 16:22:31,254 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000005_0'
2013-10-31 16:22:31,256 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3283441132058347550 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:31,256 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3283441132058347550 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:31,256 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3283441132058347550 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:31,262 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0039_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:31,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039	dst=null	perm=null
2013-10-31 16:22:31,262 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary
2013-10-31 16:22:31,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2013-10-31 16:22:31,283 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:31,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2013-10-31 16:22:31,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2013-10-31 16:22:31,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2013-10-31 16:22:31,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2013-10-31 16:22:31,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2013-10-31 16:22:31,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2013-10-31 16:22:31,293 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37188, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-880140191113664544_1459, duration: 275753
2013-10-31 16:22:31,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2013-10-31 16:22:31,297 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57225, bytes: 41, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1428969296953013366_1458, duration: 254565
2013-10-31 16:22:31,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2013-10-31 16:22:31,301 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37190, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3766852199179531138_1462, duration: 267654
2013-10-31 16:22:31,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2013-10-31 16:22:31,304 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57227, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2408232434680552120_1462, duration: 250572
2013-10-31 16:22:31,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2013-10-31 16:22:31,307 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37192, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2307814493574241169_1462, duration: 249179
2013-10-31 16:22:31,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2013-10-31 16:22:31,325 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:31,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2013-10-31 16:22:31,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2013-10-31 16:22:31,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2013-10-31 16:22:31,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2013-10-31 16:22:31,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2013-10-31 16:22:31,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2013-10-31 16:22:31,335 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57229, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-880140191113664544_1459, duration: 261171
2013-10-31 16:22:31,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2013-10-31 16:22:31,339 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57230, bytes: 41, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1428969296953013366_1458, duration: 257533
2013-10-31 16:22:31,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2013-10-31 16:22:31,342 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50228, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3766852199179531138_1462, duration: 254165
2013-10-31 16:22:31,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2013-10-31 16:22:31,346 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50229, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2408232434680552120_1462, duration: 254201
2013-10-31 16:22:31,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2013-10-31 16:22:31,349 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57233, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2307814493574241169_1462, duration: 258439
2013-10-31 16:22:31,349 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joininnerouter
2013-10-31 16:22:31,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2013-10-31 16:22:31,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2013-10-31 16:22:31,355 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37198, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-880140191113664544_1459, duration: 281171
2013-10-31 16:22:31,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2013-10-31 16:22:31,358 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37199, bytes: 41, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1428969296953013366_1458, duration: 144601
2013-10-31 16:22:31,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2013-10-31 16:22:31,360 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57236, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3766852199179531138_1462, duration: 112426
2013-10-31 16:22:31,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2013-10-31 16:22:31,363 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37132, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2408232434680552120_1462, duration: 106175
2013-10-31 16:22:31,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2013-10-31 16:22:31,365 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57238, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2307814493574241169_1462, duration: 109203
2013-10-31 16:22:31,374 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:22:31,374 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:22:31,385 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:22:31,385 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:22:31,386 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:22:31,386 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields"]
2013-10-31 16:22:31,386 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  parallel execution is enabled: true
2013-10-31 16:22:31,387 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  starting jobs: 1
2013-10-31 16:22:31,387 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper]  allocating threads: 1
2013-10-31 16:22:31,388 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...dpipesplatform/difffields
2013-10-31 16:22:31,391 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:22:31,391 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:22:31,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:31,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 16:22:31,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:31,420 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar. blk_-7119918970507031873_1464
2013-10-31 16:22:31,422 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119918970507031873_1464 src: /127.0.0.1:57239 dest: /127.0.0.1:41648
2013-10-31 16:22:31,423 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119918970507031873_1464 src: /127.0.0.1:37204 dest: /127.0.0.1:38271
2013-10-31 16:22:31,425 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119918970507031873_1464 src: /127.0.0.1:50238 dest: /127.0.0.1:47311
2013-10-31 16:22:31,437 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50238, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7119918970507031873_1464, duration: 7170011
2013-10-31 16:22:31,437 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7119918970507031873_1464 terminating
2013-10-31 16:22:31,438 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37204, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7119918970507031873_1464, duration: 8016447
2013-10-31 16:22:31,438 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7119918970507031873_1464 terminating
2013-10-31 16:22:31,438 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57239, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7119918970507031873_1464, duration: 8837336
2013-10-31 16:22:31,439 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7119918970507031873_1464 terminating
2013-10-31 16:22:31,442 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7119918970507031873_1464 size 238055
2013-10-31 16:22:31,442 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar from client DFSClient_1457307213
2013-10-31 16:22:31,443 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar is closed by DFSClient_1457307213
2013-10-31 16:22:31,443 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7119918970507031873_1464 size 238055
2013-10-31 16:22:31,443 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7119918970507031873_1464 size 238055
2013-10-31 16:22:31,452 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar. New replication is 10
2013-10-31 16:22:31,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar	dst=null	perm=null
2013-10-31 16:22:31,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:31,471 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:22:31,475 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:22:31,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:22:31,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:31,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:31,493 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split. New replication is 10
2013-10-31 16:22:32,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split	dst=null	perm=null
2013-10-31 16:22:32,494 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split. blk_4065104606401556411_1465
2013-10-31 16:22:32,496 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4065104606401556411_1465 src: /127.0.0.1:50239 dest: /127.0.0.1:47311
2013-10-31 16:22:32,497 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4065104606401556411_1465 src: /127.0.0.1:57243 dest: /127.0.0.1:41648
2013-10-31 16:22:32,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4065104606401556411_1465 src: /127.0.0.1:37139 dest: /127.0.0.1:50942
2013-10-31 16:22:32,501 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4065104606401556411_1465 src: /127.0.0.1:37209 dest: /127.0.0.1:38271
2013-10-31 16:22:32,504 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37209, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4065104606401556411_1465, duration: 121186
2013-10-31 16:22:32,504 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4065104606401556411_1465 terminating
2013-10-31 16:22:32,505 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37139, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4065104606401556411_1465, duration: 965915
2013-10-31 16:22:32,506 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4065104606401556411_1465 size 1732
2013-10-31 16:22:32,506 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4065104606401556411_1465 terminating
2013-10-31 16:22:32,506 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57243, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4065104606401556411_1465, duration: 2213696
2013-10-31 16:22:32,507 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4065104606401556411_1465 terminating
2013-10-31 16:22:32,507 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50239, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4065104606401556411_1465, duration: 3243831
2013-10-31 16:22:32,507 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4065104606401556411_1465 terminating
2013-10-31 16:22:32,508 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4065104606401556411_1465 size 1732
2013-10-31 16:22:32,509 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split from client DFSClient_1457307213
2013-10-31 16:22:32,510 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split is closed by DFSClient_1457307213
2013-10-31 16:22:32,510 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4065104606401556411_1465 size 1732
2013-10-31 16:22:32,511 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4065104606401556411_1465 size 1732
2013-10-31 16:22:32,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:32,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:32,535 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo. blk_4703071415899710414_1466
2013-10-31 16:22:32,536 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4703071415899710414_1466 src: /127.0.0.1:37210 dest: /127.0.0.1:38271
2013-10-31 16:22:32,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4703071415899710414_1466 src: /127.0.0.1:50244 dest: /127.0.0.1:47311
2013-10-31 16:22:32,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4703071415899710414_1466 src: /127.0.0.1:57248 dest: /127.0.0.1:41648
2013-10-31 16:22:32,542 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57248, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4703071415899710414_1466, duration: 67241
2013-10-31 16:22:32,543 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4703071415899710414_1466 terminating
2013-10-31 16:22:32,543 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50244, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4703071415899710414_1466, duration: 873659
2013-10-31 16:22:32,544 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4703071415899710414_1466 terminating
2013-10-31 16:22:32,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37210, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4703071415899710414_1466, duration: 1726818
2013-10-31 16:22:32,545 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4703071415899710414_1466 terminating
2013-10-31 16:22:32,547 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4703071415899710414_1466 size 183
2013-10-31 16:22:32,547 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4703071415899710414_1466 size 183
2013-10-31 16:22:32,548 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4703071415899710414_1466 size 183
2013-10-31 16:22:32,590 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0039
2013-10-31 16:22:32,590 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0039 being deleted.
2013-10-31 16:22:32,947 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:22:32,948 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:22:32,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:32,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:32,977 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml. blk_1832285968670934940_1467
2013-10-31 16:22:32,978 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1832285968670934940_1467 src: /127.0.0.1:50246 dest: /127.0.0.1:47311
2013-10-31 16:22:32,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1832285968670934940_1467 src: /127.0.0.1:57250 dest: /127.0.0.1:41648
2013-10-31 16:22:32,981 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1832285968670934940_1467 src: /127.0.0.1:37215 dest: /127.0.0.1:38271
2013-10-31 16:22:32,984 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37215, dest: /127.0.0.1:38271, bytes: 28267, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1832285968670934940_1467, duration: 110396
2013-10-31 16:22:32,985 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1832285968670934940_1467 terminating
2013-10-31 16:22:32,985 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57250, dest: /127.0.0.1:41648, bytes: 28267, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1832285968670934940_1467, duration: 950603
2013-10-31 16:22:32,986 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1832285968670934940_1467 terminating
2013-10-31 16:22:32,986 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50246, dest: /127.0.0.1:47311, bytes: 28267, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1832285968670934940_1467, duration: 2003687
2013-10-31 16:22:32,987 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1832285968670934940_1467 size 28267
2013-10-31 16:22:32,987 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1832285968670934940_1467 terminating
2013-10-31 16:22:32,989 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1832285968670934940_1467 size 28267
2013-10-31 16:22:32,989 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml from client DFSClient_1457307213
2013-10-31 16:22:32,989 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml is closed by DFSClient_1457307213
2013-10-31 16:22:32,990 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1832285968670934940_1467 size 28267
2013-10-31 16:22:33,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml	dst=null	perm=null
2013-10-31 16:22:33,006 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50250, bytes: 28491, op: HDFS_READ, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1832285968670934940_1467, duration: 397686
2013-10-31 16:22:33,024 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0040: nMaps=5 nReduces=0 max=-1
2013-10-31 16:22:33,025 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0040 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:22:33,025 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0040
2013-10-31 16:22:33,025 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031160444934_0040	RESULT=SUCCESS
2013-10-31 16:22:33,025 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0040
2013-10-31 16:22:33,026 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0040
2013-10-31 16:22:33,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:33,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:33,060 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_conf.xml. blk_-1904464405163911237_1469
2013-10-31 16:22:33,062 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1904464405163911237_1469 src: /127.0.0.1:37218 dest: /127.0.0.1:38271
2013-10-31 16:22:33,064 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1904464405163911237_1469 src: /127.0.0.1:37150 dest: /127.0.0.1:50942
2013-10-31 16:22:33,065 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1904464405163911237_1469 src: /127.0.0.1:50253 dest: /127.0.0.1:47311
2013-10-31 16:22:33,069 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50253, dest: /127.0.0.1:47311, bytes: 28332, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1904464405163911237_1469, duration: 536060
2013-10-31 16:22:33,069 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1904464405163911237_1469 terminating
2013-10-31 16:22:33,070 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37150, dest: /127.0.0.1:50942, bytes: 28332, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1904464405163911237_1469, duration: 1426402
2013-10-31 16:22:33,071 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1904464405163911237_1469 terminating
2013-10-31 16:22:33,071 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1904464405163911237_1469 size 28332
2013-10-31 16:22:33,071 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37218, dest: /127.0.0.1:38271, bytes: 28332, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1904464405163911237_1469, duration: 2605158
2013-10-31 16:22:33,072 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1904464405163911237_1469 terminating
2013-10-31 16:22:33,073 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_conf.xml from client DFSClient_1064441706
2013-10-31 16:22:33,074 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_conf.xml is closed by DFSClient_1064441706
2013-10-31 16:22:33,075 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1904464405163911237_1469 size 28332
2013-10-31 16:22:33,075 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1904464405163911237_1469 size 28332
2013-10-31 16:22:33,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:33,088 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken. blk_-3316025396248904415_1470
2013-10-31 16:22:33,090 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3316025396248904415_1470 src: /127.0.0.1:37152 dest: /127.0.0.1:50942
2013-10-31 16:22:33,092 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3316025396248904415_1470 src: /127.0.0.1:50255 dest: /127.0.0.1:47311
2013-10-31 16:22:33,093 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3316025396248904415_1470 src: /127.0.0.1:37223 dest: /127.0.0.1:38271
2013-10-31 16:22:33,096 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37223, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3316025396248904415_1470, duration: 65003
2013-10-31 16:22:33,096 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3316025396248904415_1470 terminating
2013-10-31 16:22:33,097 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50255, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3316025396248904415_1470, duration: 832195
2013-10-31 16:22:33,097 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3316025396248904415_1470 terminating
2013-10-31 16:22:33,098 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37152, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3316025396248904415_1470, duration: 1630867
2013-10-31 16:22:33,098 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3316025396248904415_1470 terminating
2013-10-31 16:22:33,100 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3316025396248904415_1470 size 116
2013-10-31 16:22:33,100 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken from client DFSClient_1457307213
2013-10-31 16:22:33,101 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken is closed by DFSClient_1457307213
2013-10-31 16:22:33,101 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3316025396248904415_1470 size 116
2013-10-31 16:22:33,102 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3316025396248904415_1470 size 116
2013-10-31 16:22:33,106 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken
2013-10-31 16:22:33,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo	dst=null	perm=null
2013-10-31 16:22:33,110 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57260, bytes: 187, op: HDFS_READ, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4703071415899710414_1466, duration: 271447
2013-10-31 16:22:33,111 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0040 = 19. Number of splits = 5
2013-10-31 16:22:33,111 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,112 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,112 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,112 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,112 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,113 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,113 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,113 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,113 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,114 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,114 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,114 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,114 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,115 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,115 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,115 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0040 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:22:33,115 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0040 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:22:33,395 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-7119918970507031873_1464 to datanode(s) 127.0.0.1:50942
2013-10-31 16:22:33,395 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete  blk_3283441132058347550_1457
2013-10-31 16:22:33,395 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete  blk_3283441132058347550_1457
2013-10-31 16:22:33,579 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3283441132058347550_1457 file build/test/data/dfs/data/data4/current/blk_3283441132058347550 for deletion
2013-10-31 16:22:33,579 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3283441132058347550_1457 at file build/test/data/dfs/data/data4/current/blk_3283441132058347550
2013-10-31 16:22:34,118 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0040_m_000006_0' to tip task_20131031160444934_0040_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:34,123 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000000_0'
2013-10-31 16:22:34,123 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000001_0'
2013-10-31 16:22:34,123 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000006_0'
2013-10-31 16:22:34,125 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:22:34,126 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000006_0 which needs 1 slots
2013-10-31 16:22:34,126 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000006_0 which needs 1 slots
2013-10-31 16:22:34,127 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000002_0'
2013-10-31 16:22:34,128 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000003_0'
2013-10-31 16:22:34,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken	dst=null	perm=null
2013-10-31 16:22:34,135 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37159, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3316025396248904415_1470, duration: 299695
2013-10-31 16:22:34,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml	dst=null	perm=null
2013-10-31 16:22:34,146 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57266, bytes: 28491, op: HDFS_READ, cliID: DFSClient_251345186, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1832285968670934940_1467, duration: 383352
2013-10-31 16:22:34,176 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:34,195 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-7119918970507031873_1464 to 127.0.0.1:50942 
2013-10-31 16:22:34,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3283441132058347550_1457 file build/test/data/dfs/data/data5/current/subdir63/blk_3283441132058347550 for deletion
2013-10-31 16:22:34,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3283441132058347550_1457 at file build/test/data/dfs/data/data5/current/subdir63/blk_3283441132058347550
2013-10-31 16:22:34,197 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-7119918970507031873_1464 to /127.0.0.1:50942
2013-10-31 16:22:34,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119918970507031873_1464 src: /127.0.0.1:37162 dest: /127.0.0.1:50942
2013-10-31 16:22:34,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar	dst=null	perm=null
2013-10-31 16:22:34,200 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-7119918970507031873_1464 src: /127.0.0.1:37162 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:22:34,202 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37232, bytes: 239915, op: HDFS_READ, cliID: DFSClient_251345186, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7119918970507031873_1464, duration: 1224963
2013-10-31 16:22:34,205 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7119918970507031873_1464 size 238055
2013-10-31 16:22:34,314 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0039_m_-410323460
2013-10-31 16:22:34,322 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2229 with signal TERM. Exit code 0
2013-10-31 16:22:34,322 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_29028229
2013-10-31 16:22:34,323 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_29028229 spawned.
2013-10-31 16:22:34,326 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000006_0/taskjvm.sh
2013-10-31 16:22:35,024 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:35,024 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:35,024 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:35,024 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_-410323460 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:22:35,780 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_29028229 given task: attempt_20131031160444934_0040_m_000006_0
2013-10-31 16:22:36,256 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0039
2013-10-31 16:22:36,256 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000005_0 not found in cache
2013-10-31 16:22:36,256 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000004_0 not found in cache
2013-10-31 16:22:36,257 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0039 for user-log deletion with retainTimeStamp:1383322956257
2013-10-31 16:22:36,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:36,396 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_3283441132058347550_1457
2013-10-31 16:22:36,463 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_79344705 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:36,474 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2524 with signal TERM. Exit code 0
2013-10-31 16:22:36,647 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:36,648 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:36,648 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:36,648 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_79344705 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:37,716 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_-1907135464 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:37,726 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2779 with signal TERM. Exit code 0
2013-10-31 16:22:37,888 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:37,888 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:37,888 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:37,888 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_-1907135464 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:39,126 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0039
2013-10-31 16:22:39,126 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000000_0 not found in cache
2013-10-31 16:22:39,126 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000001_0 not found in cache
2013-10-31 16:22:39,127 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0039 for user-log deletion with retainTimeStamp:1383322959127
2013-10-31 16:22:39,129 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0039
2013-10-31 16:22:39,129 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000003_0 not found in cache
2013-10-31 16:22:39,129 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000002_0 not found in cache
2013-10-31 16:22:39,130 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0039 for user-log deletion with retainTimeStamp:1383322959130
2013-10-31 16:22:39,190 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3283441132058347550_1457 file build/test/data/dfs/data/data8/current/blk_3283441132058347550 for deletion
2013-10-31 16:22:39,191 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3283441132058347550_1457 at file build/test/data/dfs/data/data8/current/blk_3283441132058347550
2013-10-31 16:22:39,202 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000006_0 0.0% setup
2013-10-31 16:22:39,204 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000006_0 is done.
2013-10-31 16:22:39,205 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000006_0  was -1
2013-10-31 16:22:39,205 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:39,459 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_-1078247713 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:39,469 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2525 with signal TERM. Exit code 0
2013-10-31 16:22:39,470 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_868079514 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:39,480 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2523 with signal TERM. Exit code 0
2013-10-31 16:22:39,694 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:39,694 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:39,694 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:39,694 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_868079514 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:39,831 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:39,831 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:39,832 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:39,832 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_-1078247713 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:39,848 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:22:39,855 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,860 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,866 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,869 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_814554802 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:39,873 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,878 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,879 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2417 with signal TERM. Exit code 0
2013-10-31 16:22:39,884 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,884 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 16:22:40,032 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:40,032 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:40,032 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 16:22:40,032 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_814554802 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:40,132 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000006_0' has completed task_20131031160444934_0040_m_000006 successfully.
2013-10-31 16:22:40,137 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000000_0' to tip task_20131031160444934_0040_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:40,138 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000000
2013-10-31 16:22:40,139 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000001_0' to tip task_20131031160444934_0040_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:40,139 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000001
2013-10-31 16:22:40,141 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000002_0' to tip task_20131031160444934_0040_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:22:40,142 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:22:40,142 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000002
2013-10-31 16:22:40,143 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:22:40,144 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000003_0' to tip task_20131031160444934_0040_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:22:40,144 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000000_0 which needs 1 slots
2013-10-31 16:22:40,145 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000000_0 which needs 1 slots
2013-10-31 16:22:40,145 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000003
2013-10-31 16:22:40,145 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000001_0 which needs 1 slots
2013-10-31 16:22:40,146 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0040_m_000001_0 which needs 1 slots
2013-10-31 16:22:40,149 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:22:40,152 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:22:40,152 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000002_0 which needs 1 slots
2013-10-31 16:22:40,152 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000002_0 which needs 1 slots
2013-10-31 16:22:40,153 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000003_0 which needs 1 slots
2013-10-31 16:22:40,153 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0040_m_000003_0 which needs 1 slots
2013-10-31 16:22:40,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken	dst=null	perm=null
2013-10-31 16:22:40,161 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37235, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3316025396248904415_1470, duration: 303082
2013-10-31 16:22:40,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml	dst=null	perm=null
2013-10-31 16:22:40,171 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57273, bytes: 28491, op: HDFS_READ, cliID: DFSClient_-1517381369, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1832285968670934940_1467, duration: 160007
2013-10-31 16:22:40,179 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_106789973
2013-10-31 16:22:40,180 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_106789973 spawned.
2013-10-31 16:22:40,180 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0040/attempt_20131031160444934_0040_m_000000_0. Attempting to reuse: jvm_20131031160444934_0040_m_29028229
2013-10-31 16:22:40,181 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000001_0/taskjvm.sh
2013-10-31 16:22:40,235 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:40,254 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_29028229 given task: attempt_20131031160444934_0040_m_000000_0
2013-10-31 16:22:40,263 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000004_0' to tip task_20131031160444934_0040_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:22:40,264 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000004
2013-10-31 16:22:40,265 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:22:40,266 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000004_0 which needs 1 slots
2013-10-31 16:22:40,266 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000004_0 which needs 1 slots
2013-10-31 16:22:40,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken	dst=null	perm=null
2013-10-31 16:22:40,318 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37238, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3316025396248904415_1470, duration: 156240
2013-10-31 16:22:40,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml	dst=null	perm=null
2013-10-31 16:22:40,327 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57276, bytes: 28491, op: HDFS_READ, cliID: DFSClient_-1105132378, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1832285968670934940_1467, duration: 162295
2013-10-31 16:22:40,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar	dst=null	perm=null
2013-10-31 16:22:40,331 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37241, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1517381369, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7119918970507031873_1464, duration: 597005
2013-10-31 16:22:40,341 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:40,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar	dst=null	perm=null
2013-10-31 16:22:40,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57278, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1105132378, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7119918970507031873_1464, duration: 636646
2013-10-31 16:22:40,386 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_1059952678
2013-10-31 16:22:40,387 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_1059952678 spawned.
2013-10-31 16:22:40,387 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_1963016599
2013-10-31 16:22:40,387 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_1963016599 spawned.
2013-10-31 16:22:40,388 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000003_0/taskjvm.sh
2013-10-31 16:22:40,389 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000002_0/taskjvm.sh
2013-10-31 16:22:40,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split	dst=null	perm=null
2013-10-31 16:22:40,402 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37174, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4065104606401556411_1465, duration: 166524
2013-10-31 16:22:40,410 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_-1954864103
2013-10-31 16:22:40,411 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_-1954864103 spawned.
2013-10-31 16:22:40,412 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000004_0/taskjvm.sh
2013-10-31 16:22:41,140 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_106789973 given task: attempt_20131031160444934_0040_m_000001_0
2013-10-31 16:22:41,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:22:41,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:41,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split	dst=null	perm=null
2013-10-31 16:22:41,795 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37246, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4065104606401556411_1465, duration: 170475
2013-10-31 16:22:41,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:41,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:22:41,856 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37178, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 128646
2013-10-31 16:22:41,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:41,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:42,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:42,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:42,089 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37180, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 126080
2013-10-31 16:22:42,092 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37250, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 109304
2013-10-31 16:22:42,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:42,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:42,098 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37182, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 104998
2013-10-31 16:22:42,099 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000. blk_1029130384283372836_1472
2013-10-31 16:22:42,107 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001. blk_3132855957661818780_1472
2013-10-31 16:22:42,122 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1029130384283372836_1472 src: /127.0.0.1:37183 dest: /127.0.0.1:50942
2013-10-31 16:22:42,123 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1029130384283372836_1472 src: /127.0.0.1:57290 dest: /127.0.0.1:41648
2013-10-31 16:22:42,124 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1029130384283372836_1472 src: /127.0.0.1:50288 dest: /127.0.0.1:47311
2013-10-31 16:22:42,127 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50288, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1029130384283372836_1472, duration: 2357055
2013-10-31 16:22:42,128 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1029130384283372836_1472 terminating
2013-10-31 16:22:42,128 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57290, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1029130384283372836_1472, duration: 2490784
2013-10-31 16:22:42,128 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1029130384283372836_1472 terminating
2013-10-31 16:22:42,128 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37183, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1029130384283372836_1472, duration: 3274433
2013-10-31 16:22:42,129 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1029130384283372836_1472 terminating
2013-10-31 16:22:42,129 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1029130384283372836_1472 size 8
2013-10-31 16:22:42,130 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0040_m_000000_0
2013-10-31 16:22:42,131 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0040_m_000000_0
2013-10-31 16:22:42,131 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1029130384283372836_1472 size 8
2013-10-31 16:22:42,131 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3132855957661818780_1472 src: /127.0.0.1:37253 dest: /127.0.0.1:38271
2013-10-31 16:22:42,131 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1029130384283372836_1472 size 8
2013-10-31 16:22:42,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3132855957661818780_1472 src: /127.0.0.1:37187 dest: /127.0.0.1:50942
2013-10-31 16:22:42,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3132855957661818780_1472 src: /127.0.0.1:50290 dest: /127.0.0.1:47311
2013-10-31 16:22:42,134 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50290, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3132855957661818780_1472, duration: 1076873
2013-10-31 16:22:42,135 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3132855957661818780_1472 terminating
2013-10-31 16:22:42,135 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37187, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3132855957661818780_1472, duration: 1479015
2013-10-31 16:22:42,135 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3132855957661818780_1472 terminating
2013-10-31 16:22:42,135 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3132855957661818780_1472 size 8
2013-10-31 16:22:42,135 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37253, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3132855957661818780_1472, duration: 1904426
2013-10-31 16:22:42,136 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3132855957661818780_1472 terminating
2013-10-31 16:22:42,136 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0040_m_000001_0
2013-10-31 16:22:42,136 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0040_m_000001_0
2013-10-31 16:22:42,138 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3132855957661818780_1472 size 8
2013-10-31 16:22:42,139 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3132855957661818780_1472 size 8
2013-10-31 16:22:42,171 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:42,171 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000000_0 0.0% 
2013-10-31 16:22:42,184 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:42,184 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000001_0 0.0% 
2013-10-31 16:22:42,236 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_1059952678 given task: attempt_20131031160444934_0040_m_000003_0
2013-10-31 16:22:42,476 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_1963016599 given task: attempt_20131031160444934_0040_m_000002_0
2013-10-31 16:22:42,482 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_-1954864103 given task: attempt_20131031160444934_0040_m_000004_0
2013-10-31 16:22:42,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split	dst=null	perm=null
2013-10-31 16:22:42,737 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57297, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4065104606401556411_1465, duration: 157866
2013-10-31 16:22:42,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:22:42,776 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37262, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 126153
2013-10-31 16:22:42,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:42,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:42,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split	dst=null	perm=null
2013-10-31 16:22:42,969 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50298, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4065104606401556411_1465, duration: 162014
2013-10-31 16:22:42,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split	dst=null	perm=null
2013-10-31 16:22:42,997 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37197, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4065104606401556411_1465, duration: 505334
2013-10-31 16:22:43,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:22:43,010 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37198, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 113277
2013-10-31 16:22:43,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:43,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:43,018 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57304, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 120242
2013-10-31 16:22:43,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:43,027 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003. blk_-7009694866102085401_1474
2013-10-31 16:22:43,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:43,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 16:22:43,036 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37201, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 114981
2013-10-31 16:22:43,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:43,050 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7009694866102085401_1474 src: /127.0.0.1:57305 dest: /127.0.0.1:41648
2013-10-31 16:22:43,051 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7009694866102085401_1474 src: /127.0.0.1:37202 dest: /127.0.0.1:50942
2013-10-31 16:22:43,052 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7009694866102085401_1474 src: /127.0.0.1:50305 dest: /127.0.0.1:47311
2013-10-31 16:22:43,054 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50305, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7009694866102085401_1474, duration: 1341820
2013-10-31 16:22:43,054 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7009694866102085401_1474 terminating
2013-10-31 16:22:43,055 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37202, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7009694866102085401_1474, duration: 1502943
2013-10-31 16:22:43,055 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7009694866102085401_1474 terminating
2013-10-31 16:22:43,055 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57305, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7009694866102085401_1474, duration: 1872932
2013-10-31 16:22:43,055 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7009694866102085401_1474 terminating
2013-10-31 16:22:43,055 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7009694866102085401_1474 size 8
2013-10-31 16:22:43,056 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7009694866102085401_1474 size 8
2013-10-31 16:22:43,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:43,056 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0040_m_000003_0
2013-10-31 16:22:43,056 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0040_m_000003_0
2013-10-31 16:22:43,059 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7009694866102085401_1474 size 8
2013-10-31 16:22:43,102 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:43,103 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000003_0 0.0% 
2013-10-31 16:22:43,143 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000000_0
2013-10-31 16:22:43,144 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000001_0
2013-10-31 16:22:43,150 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000003_0
2013-10-31 16:22:43,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0	dst=null	perm=null
2013-10-31 16:22:43,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:43,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:43,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0	dst=null	perm=null
2013-10-31 16:22:43,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:43,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0	dst=null	perm=null
2013-10-31 16:22:43,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:43,363 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:22:43,364 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000000_0 is done.
2013-10-31 16:22:43,365 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000000_0  was -1
2013-10-31 16:22:43,365 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:22:43,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:43,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:43,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:43,646 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50306, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 270269
2013-10-31 16:22:43,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 16:22:43,650 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37205, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 205299
2013-10-31 16:22:43,657 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002. blk_5205276690075938518_1475
2013-10-31 16:22:43,659 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004. blk_5513293134073518807_1475
2013-10-31 16:22:43,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5205276690075938518_1475 src: /127.0.0.1:57311 dest: /127.0.0.1:41648
2013-10-31 16:22:43,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5205276690075938518_1475 src: /127.0.0.1:37277 dest: /127.0.0.1:38271
2013-10-31 16:22:43,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5205276690075938518_1475 src: /127.0.0.1:37209 dest: /127.0.0.1:50942
2013-10-31 16:22:43,682 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5513293134073518807_1475 src: /127.0.0.1:50309 dest: /127.0.0.1:47311
2013-10-31 16:22:43,683 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5513293134073518807_1475 src: /127.0.0.1:37279 dest: /127.0.0.1:38271
2013-10-31 16:22:43,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37209, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5205276690075938518_1475, duration: 946721
2013-10-31 16:22:43,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5205276690075938518_1475 terminating
2013-10-31 16:22:43,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5513293134073518807_1475 src: /127.0.0.1:57316 dest: /127.0.0.1:41648
2013-10-31 16:22:43,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37277, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5205276690075938518_1475, duration: 1322464
2013-10-31 16:22:43,684 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5205276690075938518_1475 size 8
2013-10-31 16:22:43,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5205276690075938518_1475 terminating
2013-10-31 16:22:43,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57311, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5205276690075938518_1475, duration: 1985256
2013-10-31 16:22:43,685 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5205276690075938518_1475 size 8
2013-10-31 16:22:43,685 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5205276690075938518_1475 terminating
2013-10-31 16:22:43,686 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0040_m_000002_0
2013-10-31 16:22:43,686 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0040_m_000002_0
2013-10-31 16:22:43,686 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5205276690075938518_1475 size 8
2013-10-31 16:22:43,686 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57316, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5513293134073518807_1475, duration: 34554
2013-10-31 16:22:43,686 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5513293134073518807_1475 terminating
2013-10-31 16:22:43,687 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37279, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5513293134073518807_1475, duration: 484156
2013-10-31 16:22:43,687 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5513293134073518807_1475 terminating
2013-10-31 16:22:43,687 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50309, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5513293134073518807_1475, duration: 855719
2013-10-31 16:22:43,687 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5513293134073518807_1475 terminating
2013-10-31 16:22:43,690 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5513293134073518807_1475 size 8
2013-10-31 16:22:43,691 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5513293134073518807_1475 size 8
2013-10-31 16:22:43,691 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5513293134073518807_1475 size 8
2013-10-31 16:22:43,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0	dst=null	perm=null
2013-10-31 16:22:43,897 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:43,897 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000002_0 0.0% 
2013-10-31 16:22:44,089 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0040_m_000004_0
2013-10-31 16:22:44,090 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0040_m_000004_0
2013-10-31 16:22:44,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0	dst=null	perm=null
2013-10-31 16:22:44,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:44,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:44,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0	dst=null	perm=null
2013-10-31 16:22:44,144 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:44,144 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000004_0 0.0% 
2013-10-31 16:22:44,722 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:22:44,724 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000001_0 is done.
2013-10-31 16:22:44,724 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000001_0  was -1
2013-10-31 16:22:44,725 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:45,144 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0040_m_000006_0
2013-10-31 16:22:45,144 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0040_m_000006_0
2013-10-31 16:22:45,145 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0040_m_000006_0 not found in cache
2013-10-31 16:22:45,665 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:22:45,667 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000003_0 is done.
2013-10-31 16:22:45,667 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000003_0  was -1
2013-10-31 16:22:45,667 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:22:46,147 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000000_0' has completed task_20131031160444934_0040_m_000000 successfully.
2013-10-31 16:22:46,148 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000001_0' has completed task_20131031160444934_0040_m_000001 successfully.
2013-10-31 16:22:46,154 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000003_0' has completed task_20131031160444934_0040_m_000003 successfully.
2013-10-31 16:22:46,156 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000002_0
2013-10-31 16:22:46,270 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000004_0
2013-10-31 16:22:46,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0	dst=null	perm=null
2013-10-31 16:22:46,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:46,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:46,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0	dst=null	perm=null
2013-10-31 16:22:47,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0	dst=null	perm=null
2013-10-31 16:22:47,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:47,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:47,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0	dst=null	perm=null
2013-10-31 16:22:48,952 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:22:48,954 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:22:48,955 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000002_0 is done.
2013-10-31 16:22:48,955 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000002_0  was -1
2013-10-31 16:22:48,955 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:48,960 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:22:48,962 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:22:48,963 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000004_0 is done.
2013-10-31 16:22:48,963 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000004_0  was -1
2013-10-31 16:22:48,963 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:49,160 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000002_0' has completed task_20131031160444934_0040_m_000002 successfully.
2013-10-31 16:22:49,274 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000004_0' has completed task_20131031160444934_0040_m_000004 successfully.
2013-10-31 16:22:49,277 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0040_m_000005_0' to tip task_20131031160444934_0040_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:22:49,279 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:22:49,280 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000005_0 which needs 1 slots
2013-10-31 16:22:49,280 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000005_0 which needs 1 slots
2013-10-31 16:22:50,082 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_181950006
2013-10-31 16:22:50,084 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_181950006 spawned.
2013-10-31 16:22:50,086 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000005_0/taskjvm.sh
2013-10-31 16:22:51,279 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_181950006 given task: attempt_20131031160444934_0040_m_000005_0
2013-10-31 16:22:51,798 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000005_0 0.0% 
2013-10-31 16:22:51,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary	dst=null	perm=null
2013-10-31 16:22:51,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:51,831 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_SUCCESS from client DFSClient_attempt_20131031160444934_0040_m_000005_0
2013-10-31 16:22:51,832 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0040_m_000005_0
2013-10-31 16:22:51,839 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119918970507031873 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:51,839 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119918970507031873 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:51,840 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119918970507031873 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:51,840 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119918970507031873 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:51,840 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4065104606401556411 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:51,840 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4065104606401556411 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:51,840 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4065104606401556411 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:51,840 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4065104606401556411 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:51,841 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4703071415899710414 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:51,841 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4703071415899710414 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:51,841 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4703071415899710414 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:51,841 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1832285968670934940 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:51,841 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1832285968670934940 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:51,841 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1832285968670934940 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:51,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040	dst=null	perm=null
2013-10-31 16:22:54,399 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete  blk_1832285968670934940_1467 blk_4703071415899710414_1466 blk_-7119918970507031873_1464 blk_4065104606401556411_1465
2013-10-31 16:22:54,399 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete  blk_-7119918970507031873_1464 blk_4065104606401556411_1465
2013-10-31 16:22:54,707 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000005_0 0.0% cleanup
2013-10-31 16:22:54,709 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000005_0 is done.
2013-10-31 16:22:54,709 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000005_0  was -1
2013-10-31 16:22:54,710 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:55,286 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000005_0' has completed task_20131031160444934_0040_m_000005 successfully.
2013-10-31 16:22:55,287 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0040 has completed successfully.
2013-10-31 16:22:55,288 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0040,submitTime=1383236552996,launchTime=1383236553115,firstMapTaskLaunchTime=1383236560137,firstJobSetupTaskLaunchTime=1383236554117,firstJobCleanupTaskLaunchTime=1383236569277,finishTime=1383236575287,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=40,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E32F3D93043E4CEB922DF05C02E89E52/DE1DC7DC113545DB8DAF51CAB5936FB2] lower*upper/(1/1) ...dpipesplatform/difffields
2013-10-31 16:22:55,293 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB. blk_1424377202590509271_1476
2013-10-31 16:22:55,295 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424377202590509271_1476 src: /127.0.0.1:50318 dest: /127.0.0.1:47311
2013-10-31 16:22:55,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424377202590509271_1476 src: /127.0.0.1:57322 dest: /127.0.0.1:41648
2013-10-31 16:22:55,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424377202590509271_1476 src: /127.0.0.1:37218 dest: /127.0.0.1:50942
2013-10-31 16:22:55,311 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37218, dest: /127.0.0.1:50942, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1424377202590509271_1476, duration: 5626263
2013-10-31 16:22:55,312 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1424377202590509271_1476 terminating
2013-10-31 16:22:55,312 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57322, dest: /127.0.0.1:41648, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1424377202590509271_1476, duration: 6788313
2013-10-31 16:22:55,312 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1424377202590509271_1476 terminating
2013-10-31 16:22:55,314 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1424377202590509271_1476 size 26339
2013-10-31 16:22:55,317 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1424377202590509271_1476 size 26339
2013-10-31 16:22:55,317 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50318, dest: /127.0.0.1:47311, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1424377202590509271_1476, duration: 8667296
2013-10-31 16:22:55,317 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1424377202590509271_1476 terminating
2013-10-31 16:22:55,321 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB from client DFSClient_1064441706
2013-10-31 16:22:55,322 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB is closed by DFSClient_1064441706
2013-10-31 16:22:55,322 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1424377202590509271_1476 size 26339
2013-10-31 16:22:55,338 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:55,341 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0040_m_000004_0'
2013-10-31 16:22:55,341 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0040_m_000005_0'
2013-10-31 16:22:55,344 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3316025396248904415 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:55,344 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3316025396248904415 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:55,345 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3316025396248904415 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:55,347 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0040_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:55,351 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary
2013-10-31 16:22:55,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040	dst=null	perm=null
2013-10-31 16:22:55,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields	dst=null	perm=null
2013-10-31 16:22:55,408 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:55,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2013-10-31 16:22:55,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2013-10-31 16:22:55,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2013-10-31 16:22:55,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2013-10-31 16:22:55,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2013-10-31 16:22:55,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2013-10-31 16:22:55,419 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37220, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1029130384283372836_1472, duration: 314074
2013-10-31 16:22:55,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2013-10-31 16:22:55,422 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37290, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3132855957661818780_1472, duration: 256728
2013-10-31 16:22:55,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2013-10-31 16:22:55,425 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37222, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5205276690075938518_1475, duration: 256518
2013-10-31 16:22:55,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2013-10-31 16:22:55,428 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50325, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7009694866102085401_1474, duration: 254613
2013-10-31 16:22:55,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2013-10-31 16:22:55,431 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50326, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5513293134073518807_1475, duration: 260127
2013-10-31 16:22:55,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields	dst=null	perm=null
2013-10-31 16:22:55,449 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:55,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2013-10-31 16:22:55,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2013-10-31 16:22:55,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2013-10-31 16:22:55,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2013-10-31 16:22:55,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2013-10-31 16:22:55,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2013-10-31 16:22:55,456 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37225, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1029130384283372836_1472, duration: 152494
2013-10-31 16:22:55,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2013-10-31 16:22:55,458 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37295, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3132855957661818780_1472, duration: 110093
2013-10-31 16:22:55,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2013-10-31 16:22:55,460 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37296, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5205276690075938518_1475, duration: 272940
2013-10-31 16:22:55,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2013-10-31 16:22:55,462 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57333, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7009694866102085401_1474, duration: 265479
2013-10-31 16:22:55,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2013-10-31 16:22:55,464 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57334, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5513293134073518807_1475, duration: 263080
2013-10-31 16:22:55,464 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/difffields
2013-10-31 16:22:55,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields	dst=null	perm=null
2013-10-31 16:22:55,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2013-10-31 16:22:55,470 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57335, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1029130384283372836_1472, duration: 268786
2013-10-31 16:22:55,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2013-10-31 16:22:55,474 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37300, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3132855957661818780_1472, duration: 235436
2013-10-31 16:22:55,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2013-10-31 16:22:55,478 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37232, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5205276690075938518_1475, duration: 261219
2013-10-31 16:22:55,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2013-10-31 16:22:55,482 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37233, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7009694866102085401_1474, duration: 252029
2013-10-31 16:22:55,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2013-10-31 16:22:55,486 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57339, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5513293134073518807_1475, duration: 254309